Sep 28 21:28:14 devstack cinder-volume[75529]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 21:28:14 devstack cinder-volume[75529]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 21:28:14 devstack cinder-volume[75529]: we strongly recommend against using it for new projects. Sep 28 21:28:14 devstack cinder-volume[75529]: If you are already using Eventlet, we recommend migrating to a different Sep 28 21:28:14 devstack cinder-volume[75529]: framework. For more detail see Sep 28 21:28:14 devstack cinder-volume[75529]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 21:28:14 devstack cinder-volume[75529]: import eventlet # noqa Sep 28 21:28:17 devstack cinder-volume[75529]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 21:28:17 devstack cinder-volume[75529]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 21:28:17 devstack cinder-volume[75529]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 21:28:18 devstack cinder-volume[75529]: INFO dbcounter [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Registered counter for database cinder Sep 28 21:28:18 devstack cinder-volume[75529]: DEBUG oslo_db.sqlalchemy.engines [None req-525460af-c324-405d-82c7-650e256d6e1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75529) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:28:18 devstack cinder-volume[75529]: DEBUG dbcounter [-] [75529] Writer thread running {{(pid=75529) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 21:28:18 devstack cinder-volume[75529]: INFO cinder.rpc [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 21:28:18 devstack cinder-volume[75529]: INFO cinder.rpc [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 21:28:18 devstack cinder-volume[75529]: DEBUG oslo_db.sqlalchemy.engines [None req-525460af-c324-405d-82c7-650e256d6e1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75529) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:28:18 devstack cinder-volume[75529]: INFO cinder.volume.manager [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Determined volume DB was empty at startup. Sep 28 21:28:18 devstack cinder-volume[75529]: DEBUG cinder.volume.manager [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75529) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 21:28:18 devstack cinder-volume[75529]: INFO cinder.volume.manager [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 21:28:18 devstack cinder-volume[75529]: WARNING stevedore.named [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 21:28:18 devstack cinder-volume[75529]: WARNING castellan.key_manager [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 21:28:18 devstack cinder-volume[75529]: WARNING cinder.keymgr.conf_key_mgr [None req-525460af-c324-405d-82c7-650e256d6e1e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 21:28:18 devstack cinder-volume[75529]: DEBUG cinder.volume.drivers.lvm [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75529) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 21:28:18 devstack cinder-volume[75529]: DEBUG oslo_concurrency.processutils [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_concurrency.processutils [None req-525460af-c324-405d-82c7-650e256d6e1e None None] CMD "cinder-rtstool verify" returned: 0 in 0.425s {{(pid=75529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_db.sqlalchemy.engines [None req-525460af-c324-405d-82c7-650e256d6e1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75529) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:28:19 devstack cinder-volume[75529]: INFO cinder.rpc [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 21:28:19 devstack cinder-volume[75529]: INFO cinder.rpc [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 21:28:19 devstack cinder-volume[75529]: WARNING stevedore.named [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 21:28:19 devstack cinder-volume[75529]: WARNING castellan.key_manager [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 21:28:19 devstack cinder-volume[75529]: INFO cinder.volume.manager [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_db.sqlalchemy.engines [None req-525460af-c324-405d-82c7-650e256d6e1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75529) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:28:19 devstack cinder-volume[75529]: INFO oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Starting 1 workers Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Started child 75682 {{(pid=75529) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Full set of CONF: {{(pid=75529) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] ******************************************************************************** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Configuration options gathered from: {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] ================================================================================ {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] allow_availability_zone_fallback = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] allow_compression_on_image_upload = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75682]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] allowed_direct_url_schemes = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] api_rate_limit = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] auth_strategy = keystone {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] az_cache_duration = 3600 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_availability_zone = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_host = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_stats_polling_interval = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backup_api_class = cinder.backup.api.API {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backup_name_template = backup-%s {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backup_use_same_host = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backup_use_temp_snapshot = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] chap_password = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] chap_username = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_internal_tenant_project_id = 1dab5d09e6df4b4c86668f76986607a8 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_internal_tenant_user_id = e7361931b0184ba589f98acac3ca8ee1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cloned_volume_same_az = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cluster = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] compression_format = gzip {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] compute_api_class = cinder.compute.nova.API {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] config_dir = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] config_source = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] control_exchange = openstack {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] debug = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] default_availability_zone = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] default_group_type = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] default_volume_type = lvmdriver-1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] disk_geometry = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] driver_client_cert = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] driver_client_cert_key = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] driver_data_namespace = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] driver_ssl_cert_path = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] driver_ssl_cert_verify = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] driver_use_ssl = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] enable_force_upload = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] enable_new_services = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] enable_unsupported_driver = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] enabled_backends = ['lvmdriver-1'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] enforce_multipath_for_image_xfer = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] filter_function = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_api_insecure = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_api_ssl_compression = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_ca_certificates_file = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_catalog_info = image:glance:publicURL {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_certfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_keyfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_num_retries = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance_request_timeout = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] goodness_function = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] graceful_shutdown_timeout = 5 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] group_api_class = cinder.group.api.API {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] host = devstack {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_compress_on_upload = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_conversion_address_space_limit = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_conversion_cpu_limit = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_conversion_disable = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_introspection_address_space_limit = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_introspection_cpu_limit = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_upload_use_cinder_backend = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_upload_use_internal_tenant = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_volume_cache_enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_volume_cache_max_count = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] image_volume_cache_max_size_gb = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] init_host_max_objects_retrieval = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] instance_format = [instance: %(uuid)s] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] iscsi_target_flags = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] iscsi_write_cache = on {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] iser_helper = tgtadm {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] iser_ip_address = 192.168.122.74 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] iser_port = 3260 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75682]: INFO cinder.volume.manager [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_color = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_config_append = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_dir = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_file = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_options = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_rotate_interval = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_rotate_interval_type = days {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] log_rotation_type = none {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] max_age = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] max_logfile_count = 30 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] max_logfile_size_mb = 200 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] max_over_subscription_ratio = 20.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] message_reap_interval = 86400 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] message_ttl = 2592000 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] migration_create_volume_timeout_secs = 300 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] monkey_patch = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] monkey_patch_modules = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] my_ip = 192.168.122.74 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] no_snapshot_gb_quota = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] num_iser_scan_tries = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] num_shell_tries = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] num_volume_device_scan_tries = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] nvmeof_conn_info_version = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] nvmet_ns_id = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] nvmet_port_id = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] osapi_max_limit = 1000 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] osapi_volume_ext_list = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] osapi_volume_listen = 0.0.0.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] osapi_volume_listen_port = 8776 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] osapi_volume_use_ssl = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] osapi_volume_workers = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] per_volume_size_limit = -1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] periodic_fuzzy_delay = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] periodic_interval = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] project_id_regex = [0-9a-f\-]+ {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] public_endpoint = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] publish_errors = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] quota_backup_gigabytes = 1000 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] quota_backups = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] quota_gigabytes = 1000 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] quota_groups = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] quota_snapshots = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] quota_volumes = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] rate_limit_burst = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] rate_limit_except_level = CRITICAL {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] rate_limit_interval = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] reinit_driver_count = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] replication_device = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] report_discard_supported = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] report_interval = 120 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] reservation_clean_interval = 86400 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] reservation_expire = 86400 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] reserved_image_namespaces = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] reserved_percentage = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] rpc_response_timeout = 120 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] run_external_periodic_tasks = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] scst_target_driver = iscsi {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] scst_target_iqn_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_down_time = 720 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] shell_completion = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] snapshot_name_template = snapshot-%s {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] snapshot_same_host = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] split_loggers = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] state_path = /opt/stack/data/cinder {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] storage_availability_zone = nova {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] storage_protocol = iSCSI {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] syslog_log_facility = LOG_USER {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] target_helper = lioadm {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] target_ip_address = 192.168.122.74 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] target_port = 3260 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] target_protocol = iscsi {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] target_secondary_ip_addresses = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] trace_flags = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] transfer_api_class = cinder.transfer.api.API {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] transport_url = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.066s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] until_refresh = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] use_chap_auth = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] use_default_quota_class = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] use_journal = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] use_json = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] use_multipath_for_image_xfer = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] use_stderr = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] use_syslog = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] verify_glance_signatures = enabled {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_api_class = cinder.volume.api.API {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_backend_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_clear = zero {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_clear_ionice = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_clear_size = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_copy_bps_limit = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_dd_blocksize = 1M {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_name_template = volume-%s {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_service_inithost_offload = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volume_usage_audit_period = month {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] zoning_mode = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_concurrency.disable_process_locking = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.auth_section = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.auth_type = password {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.auth_version = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.cache = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.certfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.delay_auth_decision = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.http_connect_timeout = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.include_service_catalog = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.insecure = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.interface = public {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.keyfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_password = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcache_username = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.region_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.service_token_roles_required = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.service_type = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.token_cache_time = 300 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.backend = dogpile.cache.null {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.backend_argument = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.backend_expiration_time = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.config_prefix = cache.oslo {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.debug_cache_backend = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.enable_retry_client = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.enable_socket_keepalive = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.expiration_time = 600 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.hashclient_retry_attempts = 2 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.memcache_dead_retry = 300 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.memcache_pool_maxsize = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.memcache_sasl_enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.password = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.proxies = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.redis_db = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.redis_sentinel_service_name = mymaster {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.redis_server = localhost:6379 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.retry_attempts = 2 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.retry_delay = 0.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.socket_keepalive_count = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.socket_keepalive_idle = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.socket_keepalive_interval = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.socket_timeout = 1.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.tls_allowed_ciphers = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.tls_cafile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.tls_certfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.tls_enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.tls_keyfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cache.username = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] coordination.backend_url = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.asyncio_connection = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.asyncio_slave_connection = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.backend = sqlalchemy {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.connection = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.connection_debug = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.connection_parameters = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.connection_recycle_time = 3600 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.connection_trace = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.db_inc_retry_interval = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.db_max_retries = 20 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.db_max_retry_interval = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.db_retry_interval = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.max_overflow = 50 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.max_pool_size = 5 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.max_retries = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.mysql_wsrep_sync_wait = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.pool_timeout = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.retry_interval = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.slave_connection = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.sqlite_synchronous = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.synchronous_reader = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] database.use_db_reconnect = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_tracing.insecure = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.connection_string = messaging:// {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.es_doc_type = notification {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.es_scroll_size = 10000 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.es_scroll_time = 2m {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.filter_error_trace = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.hmac_keys = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.sentinel_service_name = mymaster {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.socket_timeout = 0.1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.trace_requests = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler.trace_sqlalchemy = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler_jaeger.process_tags = {} {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler_jaeger.service_name_prefix = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] profiler_otlp.service_name_prefix = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.enforce_new_defaults = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.policy_default_rule = default {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.policy_file = policy.yaml {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_policy.remote_timeout = 60.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] privsep_osbrick.group = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] privsep_osbrick.helper_command = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack sudo[75686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 21:28:19 devstack sudo[75686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] privsep_osbrick.user = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_sys_admin.group = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_sys_admin.helper_command = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] cinder_sys_admin.user = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.auth_section = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.auth_type = password {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.cafile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.certfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.collect_timing = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.insecure = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.keyfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.send_service_user_token = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.split_loggers = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.timeout = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.tls_ciphers = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] service_user.tls_min_version = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.auth_section = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.auth_type = password {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.certfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.collect_timing = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.insecure = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.keyfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.region_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.split_loggers = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.timeout = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.tls_ciphers = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] glance.tls_min_version = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.backend_availability_zone = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.chap_password = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.chap_username = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.disk_geometry = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.driver_client_cert = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.driver_client_cert_key = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.driver_data_namespace = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.driver_use_ssl = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.enable_unsupported_driver = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.extra_capabilities = {} {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.filter_function = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.goodness_function = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.iscsi_target_flags = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.iscsi_write_cache = on {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.iser_helper = tgtadm {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.iser_port = 3260 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.lvm_mirrors = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.lvm_share_target = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.lvm_type = auto {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.num_shell_tries = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.nvmet_port_id = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.replication_device = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.report_discard_supported = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.reserved_percentage = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.scst_target_driver = iscsi {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.scst_target_iqn_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.storage_protocol = iSCSI {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.target_helper = tgtadm {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.target_port = 3260 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.target_protocol = iscsi {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.trace_flags = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.unique_fqdn_network = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.use_chap_auth = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_backend_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_clear = zero {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_clear_ionice = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_clear_size = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volume_group = cinder-volumes {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_reports.file_event_handler = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_reports.log_dir = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.backend_availability_zone = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.backend_host = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.chap_password = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.chap_username = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.chiscsi_conf = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.disk_geometry = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.driver_client_cert = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.driver_data_namespace = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.driver_use_ssl = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.extra_capabilities = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.filter_function = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.goodness_function = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.iser_helper = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.iser_ip_address = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.iser_port = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.iser_target_prefix = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.lvm_conf_file = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.lvm_mirrors = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.lvm_share_target = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.lvm_type = auto {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.num_shell_tries = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.nvmet_port_id = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.replication_device = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.report_discard_supported = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.reserved_percentage = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.scst_target_driver = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.storage_protocol = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.target_helper = lioadm {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.target_ip_address = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.target_port = 3260 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.target_protocol = iscsi {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.trace_flags = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.use_chap_auth = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_clear = zero {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_clear_size = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] lvmdriver-1.volumes_dir = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.ssl = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.ssl_version = {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_notifications.driver = [] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_notifications.retry = -1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] key_manager.fixed_key = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.barbican_api_version = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.barbican_endpoint = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.barbican_endpoint_type = public {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.barbican_region_name = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.cafile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.certfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.collect_timing = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.insecure = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.keyfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.number_of_retries = 60 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.retry_delay = 1 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.send_service_user_token = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.split_loggers = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.timeout = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.tls_ciphers = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.tls_min_version = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.verify_ssl = True {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican.verify_ssl_path = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.auth_section = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.auth_type = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.cafile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.certfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.collect_timing = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.insecure = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.keyfile = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.split_loggers = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.timeout = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.tls_ciphers = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] barbican_service_user.tls_min_version = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.approle_role_id = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.approle_secret_id = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.auth_method = approle {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.auth_path = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.kv_mountpoint = secret {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.kv_path = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.kv_version = 2 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.namespace = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.root_token_id = **** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.ssl_ca_crt_file = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.timeout = 60.0 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.token_file = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.token_role = None {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.use_ssl = False {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:28:19 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] ******************************************************************************** {{(pid=75529) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 21:28:19 devstack sudo[75686]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.356s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:19 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:19 devstack sudo[75689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:19 devstack sudo[75689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:20 devstack sudo[75689]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:20 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.278s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:20 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:28:20 devstack cinder-volume[75682]: INFO cinder.brick.local_dev.lvm [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 21:28:20 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:20 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:20 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:20 devstack sudo[75694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:28:20 devstack sudo[75694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:20 devstack sudo[75694]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:20 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:20 devstack cinder-volume[75682]: DEBUG cinder.brick.local_dev.lvm [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75682) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 21:28:20 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:20 devstack sudo[75722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:20 devstack sudo[75722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:21 devstack sudo[75722]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:21 devstack sudo[75970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:21 devstack sudo[75970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:21 devstack sudo[75970]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:21 devstack sudo[76071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 21:28:21 devstack sudo[76071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:21 devstack sudo[76071]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.255s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:21 devstack sudo[76155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:28:21 devstack sudo[76155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:21 devstack sudo[76155]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:21 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:22 devstack sudo[76230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:28:22 devstack sudo[76230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:22 devstack sudo[76230]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:22 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:22 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:22 devstack sudo[76309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:28:22 devstack sudo[76309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:22 devstack sudo[76309]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:22 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:22 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:22 devstack sudo[76317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:22 devstack sudo[76317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:22 devstack sudo[76317]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:22 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:22 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:22 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:22 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:22 devstack sudo[76397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:22 devstack sudo[76397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:23 devstack sudo[76397]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:23 devstack cinder-volume[75682]: INFO cinder.volume.drivers.lvm [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:23 devstack sudo[76407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:23 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:23 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.351s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG cinder.volume.drivers.lvm [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Updating volume stats {{(pid=75682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:23 devstack sudo[76490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:28:23 devstack sudo[76490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:23 devstack sudo[76490]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:23 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:23 devstack sudo[76499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:28:23 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:24 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:24 devstack sudo[76502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:24 devstack sudo[76502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:24 devstack sudo[76502]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:24 devstack sudo[76505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:28:24 devstack sudo[76505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:24 devstack sudo[76505]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:24 devstack cinder-volume[75682]: INFO cinder.volume.driver [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG cinder.volume.driver [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75682) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG oslo_db.sqlalchemy.engines [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writer thread running {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG cinder.db.api [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Building query based on filter {{(pid=75682) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG cinder.image.image_utils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75682) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 21:28:24 devstack cinder-volume[75682]: INFO cinder.keymgr.migration [None req-e6983e99-0e8c-4c3b-a520-1f70cc1d41f9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG cinder.volume.drivers.lvm [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Updating volume stats {{(pid=75682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 21:28:24 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:24 devstack sudo[76509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:28:24 devstack sudo[76509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:25 devstack sudo[76509]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:25 devstack sudo[76512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:28:25 devstack sudo[76512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:25 devstack sudo[76512]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:25 devstack sudo[76515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:25 devstack sudo[76515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:25 devstack sudo[76515]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:25 devstack sudo[76519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:28:25 devstack sudo[76519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:25 devstack sudo[76519]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG cinder.manager [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Notifying Schedulers of capabilities ... {{(pid=75682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:28:25 devstack cinder-volume[75682]: INFO cinder.volume.manager [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Driver initialization completed successfully. Sep 28 21:28:25 devstack cinder-volume[75682]: INFO cinder.manager [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Initiating service 2 cleanup Sep 28 21:28:25 devstack cinder-volume[75682]: INFO cinder.manager [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Service 2 cleanup completed. Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG cinder.service [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Creating RPC server for service cinder-volume {{(pid=75682) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 21:28:25 devstack cinder-volume[75682]: DEBUG cinder.service [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75682) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 21:28:26 devstack cinder-volume[75682]: INFO cinder.volume.manager [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 21:28:26 devstack cinder-volume[75682]: DEBUG cinder.volume.drivers.lvm [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Updating volume stats {{(pid=75682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 21:28:26 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:26 devstack sudo[76523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:28:26 devstack sudo[76523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:26 devstack sudo[76523]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:26 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:26 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:26 devstack sudo[76527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:28:26 devstack sudo[76527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:26 devstack sudo[76527]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:26 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:26 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:26 devstack sudo[76530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:28:26 devstack sudo[76530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:26 devstack sudo[76530]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:26 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:26 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:28:26 devstack sudo[76535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:28:26 devstack sudo[76535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:28:27 devstack sudo[76535]: pam_unix(sudo:session): session closed for user root Sep 28 21:28:27 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:28:27 devstack cinder-volume[75682]: INFO cinder.volume.manager [None req-d34b0685-c522-42f3-b194-4df962f11595 None None] Driver post RPC initialization completed successfully. Sep 28 21:28:29 devstack cinder-volume[75529]: DEBUG dbcounter [-] [75529] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75529) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:28:35 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:28:37 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:28:58 devstack cinder-volume[75682]: DEBUG oslo_service.periodic_task [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running periodic task VolumeManager._thread_info {{(pid=75682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:28:58 devstack cinder-volume[75682]: DEBUG cinder.volume.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] thread count: 6 {{(pid=75682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:28:58 devstack cinder-volume[75682]: DEBUG cinder.volume.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] thread info: [<_MainThread(MainThread, started 139548750565504)>, , , , , ] {{(pid=75682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG oslo_service.periodic_task [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG cinder.volume.drivers.lvm [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Updating volume stats {{(pid=75682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:29:58 devstack sudo[81622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:29:58 devstack sudo[81622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:29:58 devstack sudo[81622]: pam_unix(sudo:session): session closed for user root Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:29:58 devstack sudo[81625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:29:58 devstack sudo[81625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:29:58 devstack sudo[81625]: pam_unix(sudo:session): session closed for user root Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:29:58 devstack sudo[81628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:29:58 devstack sudo[81628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:29:58 devstack sudo[81628]: pam_unix(sudo:session): session closed for user root Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:29:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:29:58 devstack sudo[81631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:29:58 devstack sudo[81631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:29:59 devstack sudo[81631]: pam_unix(sudo:session): session closed for user root Sep 28 21:29:59 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:29:59 devstack cinder-volume[75682]: DEBUG cinder.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Notifying Schedulers of capabilities ... {{(pid=75682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:29:59 devstack cinder-volume[75682]: DEBUG oslo_service.periodic_task [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running periodic task VolumeManager._thread_info {{(pid=75682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:29:59 devstack cinder-volume[75682]: DEBUG cinder.volume.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] thread count: 6 {{(pid=75682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:29:59 devstack cinder-volume[75682]: DEBUG cinder.volume.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] thread info: [<_MainThread(MainThread, started 139548750565504)>, , , , , ] {{(pid=75682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:30:37 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writing DB stats cinder:SELECT=1 {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:30:37 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writing DB stats cinder:UPDATE=1 {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG oslo_service.periodic_task [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG cinder.volume.drivers.lvm [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Updating volume stats {{(pid=75682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:30:58 devstack sudo[83098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:30:58 devstack sudo[83098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:30:58 devstack sudo[83098]: pam_unix(sudo:session): session closed for user root Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:30:58 devstack sudo[83117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:30:58 devstack sudo[83117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:30:58 devstack sudo[83117]: pam_unix(sudo:session): session closed for user root Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:30:58 devstack sudo[83140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:30:58 devstack sudo[83140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:30:58 devstack sudo[83140]: pam_unix(sudo:session): session closed for user root Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:30:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:30:59 devstack sudo[83144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:30:59 devstack sudo[83144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:30:59 devstack sudo[83144]: pam_unix(sudo:session): session closed for user root Sep 28 21:30:59 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:30:59 devstack cinder-volume[75682]: DEBUG cinder.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Notifying Schedulers of capabilities ... {{(pid=75682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG oslo_service.periodic_task [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG cinder.volume.drivers.lvm [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Updating volume stats {{(pid=75682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:31:58 devstack sudo[84603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 21:31:58 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:31:58 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:31:58 devstack sudo[84606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:31:58 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:31:58 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:31:58 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 21:31:58 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:31:58 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:31:58 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:31:58 devstack sudo[84613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 21:31:58 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:31:59 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root Sep 28 21:31:59 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:31:59 devstack cinder-volume[75682]: DEBUG cinder.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Notifying Schedulers of capabilities ... {{(pid=75682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:31:59 devstack cinder-volume[75682]: DEBUG oslo_service.periodic_task [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] Running periodic task VolumeManager._thread_info {{(pid=75682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:31:59 devstack cinder-volume[75682]: DEBUG cinder.volume.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] thread count: 6 {{(pid=75682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:31:59 devstack cinder-volume[75682]: DEBUG cinder.volume.manager [None req-7c9ad8bb-4242-4832-a153-7080b193cdcf None None] thread info: [<_MainThread(MainThread, started 139548750565504)>, , , , , ] {{(pid=75682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:32:37 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writing DB stats cinder:SELECT=1 {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:32:37 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writing DB stats cinder:UPDATE=1 {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:32:47 devstack cinder-volume[75529]: INFO oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Caught SIGTERM, stopping children Sep 28 21:32:47 devstack cinder-volume[75529]: DEBUG oslo_concurrency.lockutils [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Acquiring lock "singleton_lock" {{(pid=75529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 21:32:47 devstack cinder-volume[75529]: DEBUG oslo_concurrency.lockutils [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Acquired lock "singleton_lock" {{(pid=75529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 21:32:47 devstack cinder-volume[75529]: DEBUG oslo_concurrency.lockutils [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Releasing lock "singleton_lock" {{(pid=75529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 21:32:47 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Stop services. {{(pid=75529) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 21:32:47 devstack cinder-volume[75529]: DEBUG oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Killing children. {{(pid=75529) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 21:32:47 devstack cinder-volume[75529]: INFO oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Waiting on 1 children to exit Sep 28 21:32:51 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Acquiring lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 21:32:51 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Acquired lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 21:32:51 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Releasing lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 21:32:51 devstack cinder-volume[75682]: WARNING amqp [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 21:32:51 devstack cinder-volume[75682]: WARNING amqp [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 21:32:51 devstack cinder-volume[75529]: INFO oslo_service.backend._eventlet.service [None req-525460af-c324-405d-82c7-650e256d6e1e None None] Child 75682 exited with status 0 Sep 28 21:32:51 devstack cinder-volume[85651]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 21:32:51 devstack cinder-volume[85651]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 21:32:51 devstack cinder-volume[85651]: we strongly recommend against using it for new projects. Sep 28 21:32:51 devstack cinder-volume[85651]: If you are already using Eventlet, we recommend migrating to a different Sep 28 21:32:51 devstack cinder-volume[85651]: framework. For more detail see Sep 28 21:32:51 devstack cinder-volume[85651]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 21:32:51 devstack cinder-volume[85651]: import eventlet # noqa Sep 28 21:32:53 devstack cinder-volume[85651]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 21:32:53 devstack cinder-volume[85651]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 21:32:53 devstack cinder-volume[85651]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 21:32:54 devstack cinder-volume[85651]: INFO dbcounter [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Registered counter for database cinder Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_db.sqlalchemy.engines [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG dbcounter [-] [85651] Writer thread running {{(pid=85651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 21:32:54 devstack cinder-volume[85651]: INFO cinder.rpc [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 21:32:54 devstack cinder-volume[85651]: INFO cinder.rpc [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_db.sqlalchemy.engines [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:32:54 devstack cinder-volume[85651]: INFO cinder.volume.manager [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Determined volume DB was empty at startup. Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG cinder.volume.manager [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85651) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 21:32:54 devstack cinder-volume[85651]: INFO cinder.volume.manager [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 21:32:54 devstack cinder-volume[85651]: WARNING stevedore.named [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 21:32:54 devstack cinder-volume[85651]: WARNING castellan.key_manager [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 21:32:54 devstack cinder-volume[85651]: WARNING cinder.keymgr.conf_key_mgr [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 21:32:54 devstack cinder-volume[85651]: INFO cinder.volume.manager [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_db.sqlalchemy.engines [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:32:54 devstack cinder-volume[85651]: INFO oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Starting 1 workers Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Started child 85866 {{(pid=85651) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Full set of CONF: {{(pid=85651) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] ******************************************************************************** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Configuration options gathered from: {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] ================================================================================ {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] allow_availability_zone_fallback = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] allow_compression_on_image_upload = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] allowed_direct_url_schemes = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] api_rate_limit = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] auth_strategy = keystone {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_availability_zone = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_host = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_stats_polling_interval = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85866]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backup_api_class = cinder.backup.api.API {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backup_name_template = backup-%s {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backup_use_same_host = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backup_use_temp_snapshot = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] chap_password = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] chap_username = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_internal_tenant_project_id = 1dab5d09e6df4b4c86668f76986607a8 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_internal_tenant_user_id = e7361931b0184ba589f98acac3ca8ee1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cluster = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] compression_format = gzip {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] compute_api_class = cinder.compute.nova.API {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] config_dir = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] config_source = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] control_exchange = openstack {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] debug = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] default_availability_zone = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] default_group_type = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] default_volume_type = QuobyteHD {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] disk_geometry = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] driver_client_cert = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] driver_client_cert_key = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] driver_data_namespace = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] driver_ssl_cert_path = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] driver_ssl_cert_verify = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] driver_use_ssl = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] enable_new_services = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] enable_unsupported_driver = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] enabled_backends = ['QuobyteHD'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] enforce_multipath_for_image_xfer = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] filter_function = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_api_insecure = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_api_ssl_compression = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_ca_certificates_file = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_catalog_info = image:glance:publicURL {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_certfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_keyfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_num_retries = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance_request_timeout = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] goodness_function = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] graceful_shutdown_timeout = 5 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] group_api_class = cinder.group.api.API {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] host = devstack {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_compress_on_upload = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_conversion_address_space_limit = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_conversion_cpu_limit = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_conversion_disable = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_introspection_address_space_limit = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_introspection_cpu_limit = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_upload_use_cinder_backend = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_upload_use_internal_tenant = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_volume_cache_enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_volume_cache_max_count = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] image_volume_cache_max_size_gb = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] init_host_max_objects_retrieval = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] instance_format = [instance: %(uuid)s] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] iscsi_target_flags = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] iscsi_write_cache = on {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] iser_helper = tgtadm {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] iser_ip_address = 192.168.122.74 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] iser_port = 3260 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_color = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_config_append = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_dir = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_file = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_options = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_rotate_interval = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_rotate_interval_type = days {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] log_rotation_type = none {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] max_age = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] max_logfile_count = 30 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] max_logfile_size_mb = 200 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] max_over_subscription_ratio = 20.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] message_reap_interval = 86400 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] message_ttl = 2592000 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] migration_create_volume_timeout_secs = 300 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] monkey_patch = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] monkey_patch_modules = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] my_ip = 192.168.122.74 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] no_snapshot_gb_quota = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] num_iser_scan_tries = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] num_shell_tries = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] num_volume_device_scan_tries = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] nvmeof_conn_info_version = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] nvmet_ns_id = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] nvmet_port_id = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] osapi_max_limit = 1000 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] osapi_volume_ext_list = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] osapi_volume_listen_port = 8776 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] osapi_volume_use_ssl = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] osapi_volume_workers = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] per_volume_size_limit = -1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] periodic_fuzzy_delay = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85866]: INFO cinder.volume.manager [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 21:32:54 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.remotefs [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85866) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] periodic_interval = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] public_endpoint = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] publish_errors = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] quota_backup_gigabytes = 1000 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] quota_backups = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] quota_gigabytes = 1000 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] quota_groups = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] quota_snapshots = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] quota_volumes = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] rate_limit_burst = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] rate_limit_except_level = CRITICAL {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] rate_limit_interval = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] reinit_driver_count = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] replication_device = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] report_discard_supported = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] report_interval = 120 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] reservation_clean_interval = 86400 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] reservation_expire = 86400 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] reserved_image_namespaces = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] reserved_percentage = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] rpc_response_timeout = 120 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] run_external_periodic_tasks = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] scst_target_driver = iscsi {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] scst_target_iqn_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_down_time = 720 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] shell_completion = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] snapshot_name_template = snapshot-%s {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] split_loggers = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] state_path = /opt/stack/data/cinder {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] storage_availability_zone = nova {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] storage_protocol = iSCSI {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] syslog_log_facility = LOG_USER {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] target_helper = lioadm {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] target_ip_address = 192.168.122.74 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] target_port = 3260 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] target_protocol = iscsi {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] target_secondary_ip_addresses = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] trace_flags = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] transport_url = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] until_refresh = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] use_chap_auth = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] use_default_quota_class = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] use_journal = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] use_json = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] use_multipath_for_image_xfer = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] use_stderr = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] use_syslog = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] verify_glance_signatures = enabled {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_api_class = cinder.volume.api.API {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_backend_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_clear = zero {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_clear_ionice = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_clear_size = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_copy_bps_limit = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_dd_blocksize = 1M {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_name_template = volume-%s {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_service_inithost_offload = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volume_usage_audit_period = month {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] zoning_mode = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_concurrency.disable_process_locking = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.auth_section = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.auth_type = password {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.auth_version = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.cache = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.certfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.include_service_catalog = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.insecure = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.interface = public {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.keyfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_password = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcache_username = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.region_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:54 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.service_type = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.backend = dogpile.cache.null {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.backend_argument = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.backend_expiration_time = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.config_prefix = cache.oslo {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85866) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 21:32:55 devstack cinder-volume[85866]: WARNING cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 21:32:55 devstack cinder-volume[85866]: WARNING cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Running cmd (subprocess): mount.quobyte {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.debug_cache_backend = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.enable_retry_client = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.enable_socket_keepalive = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.expiration_time = 600 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.hashclient_retry_attempts = 2 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.memcache_dead_retry = 300 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.memcache_pool_maxsize = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.memcache_sasl_enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.password = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.proxies = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.redis_db = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.redis_server = localhost:6379 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.retry_attempts = 2 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.retry_delay = 0.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.socket_keepalive_count = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.socket_keepalive_idle = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.socket_keepalive_interval = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.socket_timeout = 1.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.tls_allowed_ciphers = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.tls_cafile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.tls_certfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.tls_enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.tls_keyfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cache.username = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] coordination.backend_url = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.asyncio_connection = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.asyncio_slave_connection = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.backend = sqlalchemy {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.connection = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.connection_debug = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.connection_parameters = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.connection_recycle_time = 3600 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.connection_trace = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.db_inc_retry_interval = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.db_max_retries = 20 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.db_max_retry_interval = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.db_retry_interval = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.max_overflow = 50 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.max_pool_size = 5 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.max_retries = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.mysql_wsrep_sync_wait = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.pool_timeout = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.retry_interval = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.slave_connection = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.sqlite_synchronous = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.synchronous_reader = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] database.use_db_reconnect = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_tracing.insecure = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.connection_string = messaging:// {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.es_doc_type = notification {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.es_scroll_size = 10000 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.es_scroll_time = 2m {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.filter_error_trace = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.hmac_keys = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.sentinel_service_name = mymaster {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.socket_timeout = 0.1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.trace_requests = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler.trace_sqlalchemy = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler_jaeger.process_tags = {} {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler_jaeger.service_name_prefix = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] profiler_otlp.service_name_prefix = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.enforce_new_defaults = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.policy_default_rule = default {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.policy_file = policy.yaml {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] privsep_osbrick.group = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] privsep_osbrick.helper_command = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] privsep_osbrick.user = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_sys_admin.group = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_sys_admin.helper_command = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] cinder_sys_admin.user = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.auth_section = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.auth_type = password {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.cafile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.certfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.collect_timing = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.insecure = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.keyfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.send_service_user_token = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.split_loggers = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.timeout = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.tls_ciphers = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] service_user.tls_min_version = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.auth_section = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.auth_type = password {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.certfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.collect_timing = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.insecure = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.keyfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.region_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.split_loggers = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.timeout = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.tls_ciphers = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] glance.tls_min_version = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.backend_availability_zone = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.chap_password = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.chap_username = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.disk_geometry = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.driver_client_cert = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.driver_client_cert_key = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.driver_data_namespace = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.driver_use_ssl = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.extra_capabilities = {} {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.filter_function = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.goodness_function = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.iscsi_target_flags = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.iscsi_write_cache = on {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.iser_helper = tgtadm {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.iser_port = 3260 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_host = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_login = admin {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_mount_options = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_password = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_private_key = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_share_path = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.num_shell_tries = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.quobyte_volume_url = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.replication_device = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.report_discard_supported = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.reserved_percentage = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.target_helper = tgtadm {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.target_port = 3260 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.target_protocol = iscsi {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.trace_flags = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.unique_fqdn_network = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.use_chap_auth = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volume_backend_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volume_clear = zero {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volume_clear_ionice = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volume_clear_size = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_reports.file_event_handler = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_reports.log_dir = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.backend_availability_zone = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.backend_host = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.chap_password = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.chap_username = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.chiscsi_conf = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.disk_geometry = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.driver_client_cert = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.driver_data_namespace = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.driver_use_ssl = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.extra_capabilities = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.filter_function = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.goodness_function = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.iser_helper = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.iser_ip_address = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.iser_port = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.iser_target_prefix = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_host = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_login = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_mount_options = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_password = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_private_key = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_share_path = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_ssh_port = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.num_shell_tries = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.nvmet_port_id = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.replication_device = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.report_discard_supported = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack quobyte-client[85867]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 21:32:55 devstack quobyte-client[85867]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.reserved_percentage = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.scst_target_driver = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.storage_protocol = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.target_helper = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.target_ip_address = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.target_port = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.target_prefix = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.target_protocol = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.trace_flags = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] CMD "mount.quobyte" returned: 1 in 0.163s {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=85866) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.use_chap_auth = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volume_clear = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volume_clear_size = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] QuobyteHD.volumes_dir = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85866]: INFO cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 ... Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 -c /etc/quobyte/client-cinder.cfg {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.ssl = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_notifications.driver = [] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_notifications.retry = -1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] key_manager.fixed_key = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.barbican_api_version = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.barbican_endpoint = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.barbican_endpoint_type = public {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.barbican_region_name = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.cafile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.certfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.collect_timing = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.insecure = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.keyfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.number_of_retries = 60 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.retry_delay = 1 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.send_service_user_token = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.split_loggers = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.timeout = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.tls_ciphers = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.tls_min_version = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.verify_ssl = True {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican.verify_ssl_path = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.auth_section = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.auth_type = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.cafile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.certfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.collect_timing = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.insecure = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.keyfile = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.split_loggers = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.timeout = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.tls_ciphers = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] barbican_service_user.tls_min_version = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.approle_role_id = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.approle_secret_id = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.auth_method = approle {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.auth_path = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.kv_mountpoint = secret {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.kv_path = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.kv_version = 2 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.namespace = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.root_token_id = **** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.ssl_ca_crt_file = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.timeout = 60.0 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.token_file = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.token_role = None {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.use_ssl = False {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:32:55 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] ******************************************************************************** {{(pid=85651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 21:32:55 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 -c /etc/quobyte/client-cinder.cfg Sep 28 21:32:55 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:32:55 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.404s {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:32:55 devstack cinder-volume[85866]: INFO cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 succeeded Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=85866) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.423s {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:32:55 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:32:55 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:32:55 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.235s {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:32:55 devstack cinder-volume[85866]: INFO cinder.volume.driver [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG cinder.volume.driver [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.050682067871, 'free_capacity_gb': 1775.050682067871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85866) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_db.sqlalchemy.engines [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG dbcounter [-] [85866] Writer thread running {{(pid=85866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG cinder.db.api [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Building query based on filter {{(pid=85866) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG cinder.image.image_utils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85866) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 21:32:55 devstack cinder-volume[85866]: INFO cinder.keymgr.migration [None req-d2f2512a-a517-49c0-b811-a9ce73fed9fe None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=85866) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=85866) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:32:55 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:32:56 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:32:56 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:32:56 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.229s {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG cinder.manager [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Notifying Schedulers of capabilities ... {{(pid=85866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:32:56 devstack cinder-volume[85866]: INFO cinder.volume.manager [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Driver initialization completed successfully. Sep 28 21:32:56 devstack cinder-volume[85866]: INFO cinder.manager [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Initiating service 3 cleanup Sep 28 21:32:56 devstack cinder-volume[85866]: INFO cinder.manager [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Service 3 cleanup completed. Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG cinder.service [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Creating RPC server for service cinder-volume {{(pid=85866) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG cinder.service [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85866) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 21:32:56 devstack cinder-volume[85866]: INFO cinder.volume.manager [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=85866) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=85866) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:32:56 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:32:56 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:32:56 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Sep 28 21:32:56 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.270s {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:32:56 devstack cinder-volume[85866]: INFO cinder.volume.manager [None req-ebb43e81-f739-4cc1-a8f3-deca09872763 None None] Driver post RPC initialization completed successfully. Sep 28 21:33:00 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-6d61e7b8-ba15-4cae-a929-452bb8064346 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:33:00 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-6d61e7b8-ba15-4cae-a929-452bb8064346 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:33:00 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-6d61e7b8-ba15-4cae-a929-452bb8064346 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=85866) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:33:00 devstack cinder-volume[85866]: DEBUG cinder.volume.drivers.quobyte [None req-6d61e7b8-ba15-4cae-a929-452bb8064346 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=85866) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:33:00 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-6d61e7b8-ba15-4cae-a929-452bb8064346 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85866) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:33:00 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-6d61e7b8-ba15-4cae-a929-452bb8064346 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:33:01 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:33:01 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:33:01 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Sep 28 21:33:01 devstack cinder-volume[85866]: DEBUG oslo_concurrency.processutils [None req-6d61e7b8-ba15-4cae-a929-452bb8064346 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.236s {{(pid=85866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:33:01 devstack cinder-volume[85866]: DEBUG cinder.manager [None req-6d61e7b8-ba15-4cae-a929-452bb8064346 None None] Notifying Schedulers of capabilities ... {{(pid=85866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:33:02 devstack cinder-volume[85651]: INFO oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Caught SIGTERM, stopping children Sep 28 21:33:02 devstack cinder-volume[85651]: DEBUG oslo_concurrency.lockutils [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Acquiring lock "singleton_lock" {{(pid=85651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 21:33:02 devstack cinder-volume[85651]: DEBUG oslo_concurrency.lockutils [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Acquired lock "singleton_lock" {{(pid=85651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 21:33:02 devstack cinder-volume[85651]: DEBUG oslo_concurrency.lockutils [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Releasing lock "singleton_lock" {{(pid=85651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 21:33:02 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Stop services. {{(pid=85651) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 21:33:02 devstack cinder-volume[85651]: DEBUG oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Killing children. {{(pid=85651) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 21:33:02 devstack cinder-volume[85651]: INFO oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Waiting on 1 children to exit Sep 28 21:33:04 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Acquiring lock "singleton_lock" {{(pid=85866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 21:33:04 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Acquired lock "singleton_lock" {{(pid=85866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 21:33:04 devstack cinder-volume[85866]: DEBUG oslo_concurrency.lockutils [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Releasing lock "singleton_lock" {{(pid=85866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 21:33:04 devstack cinder-volume[85866]: WARNING amqp [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 21:33:04 devstack cinder-volume[85866]: WARNING amqp [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 21:33:04 devstack cinder-volume[85651]: INFO oslo_service.backend._eventlet.service [None req-ced43756-e6eb-4b0e-bb1c-bfced0d8d085 None None] Child 85866 exited with status 0 Sep 28 21:33:05 devstack cinder-volume[86187]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 21:33:05 devstack cinder-volume[86187]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 21:33:05 devstack cinder-volume[86187]: we strongly recommend against using it for new projects. Sep 28 21:33:05 devstack cinder-volume[86187]: If you are already using Eventlet, we recommend migrating to a different Sep 28 21:33:05 devstack cinder-volume[86187]: framework. For more detail see Sep 28 21:33:05 devstack cinder-volume[86187]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 21:33:05 devstack cinder-volume[86187]: import eventlet # noqa Sep 28 21:33:08 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 21:33:08 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 21:33:08 devstack cinder-volume[86187]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 21:33:09 devstack cinder-volume[86187]: INFO dbcounter [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Registered counter for database cinder Sep 28 21:33:09 devstack cinder-volume[86187]: DEBUG oslo_db.sqlalchemy.engines [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:33:09 devstack cinder-volume[86187]: DEBUG dbcounter [-] [86187] Writer thread running {{(pid=86187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 21:33:09 devstack cinder-volume[86187]: INFO cinder.rpc [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 21:33:09 devstack cinder-volume[86187]: INFO cinder.rpc [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_db.sqlalchemy.engines [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:33:10 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Determined volume DB was empty at startup. Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG cinder.volume.manager [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86187) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 21:33:10 devstack cinder-volume[86187]: WARNING stevedore.named [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 21:33:10 devstack cinder-volume[86187]: WARNING castellan.key_manager [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 21:33:10 devstack cinder-volume[86187]: WARNING cinder.keymgr.conf_key_mgr [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 21:33:10 devstack cinder-volume[86187]: INFO cinder.volume.manager [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_db.sqlalchemy.engines [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:33:10 devstack cinder-volume[86187]: INFO oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Starting 1 workers Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Started child 86489 {{(pid=86187) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Full set of CONF: {{(pid=86187) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] ******************************************************************************** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] Configuration options gathered from: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] ================================================================================ {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 21:33:10 devstack cinder-volume[86489]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] allow_availability_zone_fallback = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] allow_compression_on_image_upload = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] allowed_direct_url_schemes = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] api_rate_limit = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] auth_strategy = keystone {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_availability_zone = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_host = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_stats_polling_interval = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backup_api_class = cinder.backup.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backup_name_template = backup-%s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backup_use_same_host = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backup_use_temp_snapshot = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] chap_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] chap_username = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_internal_tenant_project_id = 1dab5d09e6df4b4c86668f76986607a8 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_internal_tenant_user_id = e7361931b0184ba589f98acac3ca8ee1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cluster = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] compression_format = gzip {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] config_dir = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] config_source = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] control_exchange = openstack {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] debug = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] default_availability_zone = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] default_group_type = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] default_volume_type = QuobyteHD {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] disk_geometry = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] driver_client_cert = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] driver_client_cert_key = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] driver_data_namespace = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] driver_ssl_cert_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] driver_ssl_cert_verify = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] driver_use_ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] enable_new_services = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] enable_unsupported_driver = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] enforce_multipath_for_image_xfer = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] filter_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_api_insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_api_ssl_compression = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_ca_certificates_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_num_retries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance_request_timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] goodness_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] graceful_shutdown_timeout = 5 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] group_api_class = cinder.group.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] host = devstack {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_compress_on_upload = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_conversion_address_space_limit = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_conversion_cpu_limit = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_conversion_disable = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_introspection_address_space_limit = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_introspection_cpu_limit = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_upload_use_cinder_backend = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_upload_use_internal_tenant = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_volume_cache_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_volume_cache_max_count = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] init_host_max_objects_retrieval = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] instance_format = [instance: %(uuid)s] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] iscsi_target_flags = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] iscsi_write_cache = on {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] iser_helper = tgtadm {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] iser_ip_address = 192.168.122.74 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] iser_port = 3260 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_color = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_config_append = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_dir = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_options = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_rotate_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_rotate_interval_type = days {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] log_rotation_type = none {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] max_age = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] max_logfile_count = 30 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] max_logfile_size_mb = 200 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86489) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] max_over_subscription_ratio = 20.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] message_reap_interval = 86400 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] message_ttl = 2592000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] monkey_patch = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] monkey_patch_modules = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] my_ip = 192.168.122.74 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] no_snapshot_gb_quota = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] num_iser_scan_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] num_shell_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] num_volume_device_scan_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] nvmeof_conn_info_version = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] nvmet_ns_id = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] nvmet_port_id = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] osapi_max_limit = 1000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] osapi_volume_ext_list = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] osapi_volume_listen_port = 8776 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] osapi_volume_use_ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] osapi_volume_workers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] per_volume_size_limit = -1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] periodic_fuzzy_delay = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] periodic_interval = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] public_endpoint = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] publish_errors = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] quota_backup_gigabytes = 1000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] quota_backups = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] quota_gigabytes = 1000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] quota_groups = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] quota_snapshots = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] quota_volumes = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] rate_limit_burst = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] rate_limit_except_level = CRITICAL {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] rate_limit_interval = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] reinit_driver_count = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] replication_device = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] report_discard_supported = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] report_interval = 120 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] reservation_clean_interval = 86400 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] reservation_expire = 86400 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] reserved_image_namespaces = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] reserved_percentage = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] rpc_response_timeout = 120 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] run_external_periodic_tasks = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] scst_target_driver = iscsi {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] scst_target_iqn_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_down_time = 720 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] shell_completion = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] snapshot_name_template = snapshot-%s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] state_path = /opt/stack/data/cinder {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] storage_availability_zone = nova {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] storage_protocol = iSCSI {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] syslog_log_facility = LOG_USER {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] target_helper = lioadm {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] target_ip_address = 192.168.122.74 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] target_port = 3260 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] target_protocol = iscsi {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] target_secondary_ip_addresses = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] trace_flags = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] transport_url = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86489) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] until_refresh = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] use_chap_auth = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] use_default_quota_class = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] use_journal = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] use_json = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] use_multipath_for_image_xfer = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] use_stderr = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Running cmd (subprocess): mount.quobyte {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] use_syslog = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] verify_glance_signatures = enabled {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_api_class = cinder.volume.api.API {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_backend_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_clear = zero {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_clear_ionice = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_clear_size = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_copy_bps_limit = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_dd_blocksize = 1M {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_name_template = volume-%s {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_service_inithost_offload = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volume_usage_audit_period = month {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] zoning_mode = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.auth_section = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.auth_type = password {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.auth_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.cache = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.interface = public {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcache_username = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.region_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.service_type = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.backend = dogpile.cache.null {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.backend_argument = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.backend_expiration_time = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.config_prefix = cache.oslo {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.debug_cache_backend = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.enable_retry_client = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.enable_socket_keepalive = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.expiration_time = 600 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.memcache_dead_retry = 300 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.memcache_sasl_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.proxies = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.redis_db = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.redis_server = localhost:6379 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.retry_attempts = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.retry_delay = 0.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.socket_keepalive_count = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.socket_keepalive_idle = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.socket_keepalive_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.socket_timeout = 1.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.tls_allowed_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.tls_cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.tls_certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.tls_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.tls_keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cache.username = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] coordination.backend_url = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.asyncio_connection = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.asyncio_slave_connection = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.backend = sqlalchemy {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.connection = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.connection_debug = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.connection_parameters = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.connection_recycle_time = 3600 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.connection_trace = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.db_inc_retry_interval = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.db_max_retries = 20 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.db_max_retry_interval = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.db_retry_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.max_overflow = 50 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.max_pool_size = 5 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.max_retries = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.pool_timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.retry_interval = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.slave_connection = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.sqlite_synchronous = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.synchronous_reader = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] database.use_db_reconnect = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_tracing.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.connection_string = messaging:// {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.es_doc_type = notification {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.es_scroll_size = 10000 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.es_scroll_time = 2m {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.filter_error_trace = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.hmac_keys = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.sentinel_service_name = mymaster {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.socket_timeout = 0.1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.trace_requests = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler.trace_sqlalchemy = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler_jaeger.process_tags = {} {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] profiler_otlp.service_name_prefix = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack quobyte-client[86498]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.policy_default_rule = default {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack quobyte-client[86498]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] CMD "mount.quobyte" returned: 1 in 0.098s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] privsep_osbrick.group = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] privsep_osbrick.helper_command = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] privsep_osbrick.user = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_sys_admin.group = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_sys_admin.helper_command = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] cinder_sys_admin.user = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.auth_section = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.auth_type = password {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.collect_timing = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.send_service_user_token = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.tls_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] service_user.tls_min_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.auth_section = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.auth_type = password {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.collect_timing = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.region_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.tls_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] glance.tls_min_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.backend_availability_zone = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.chap_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.chap_username = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.disk_geometry = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.driver_client_cert = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.driver_data_namespace = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.driver_use_ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.extra_capabilities = {} {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.filter_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.goodness_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.iscsi_target_flags = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.iser_port = 3260 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_host = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_login = admin {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_mount_options = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_private_key = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_share_path = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.replication_device = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.report_discard_supported = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.target_helper = tgtadm {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.target_port = 3260 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.target_protocol = iscsi {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.trace_flags = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.use_chap_auth = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volume_backend_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volume_clear = zero {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_reports.file_event_handler = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_reports.log_dir = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.backend_host = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.chap_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.chap_username = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.disk_geometry = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.driver_client_cert = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.extra_capabilities = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.filter_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.goodness_function = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.iser_helper = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.iser_ip_address = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.iser_port = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_host = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_login = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_mount_options = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_password = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_private_key = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_share_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.num_shell_tries = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.replication_device = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.report_discard_supported = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.reserved_percentage = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.scst_target_driver = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.storage_protocol = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.target_helper = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.target_ip_address = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.target_port = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.target_prefix = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.target_protocol = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.trace_flags = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.use_chap_auth = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volume_clear = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volume_clear_size = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] QuobyteHD.volumes_dir = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_notifications.driver = [] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] key_manager.fixed_key = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.barbican_api_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.barbican_endpoint = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.barbican_endpoint_type = public {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.barbican_region_name = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.collect_timing = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.number_of_retries = 60 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.retry_delay = 1 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.send_service_user_token = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.tls_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.tls_min_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.verify_ssl = True {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican.verify_ssl_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.auth_section = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.auth_type = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.cafile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.certfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.collect_timing = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.insecure = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.keyfile = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.split_loggers = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.timeout = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.tls_ciphers = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] barbican_service_user.tls_min_version = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.approle_role_id = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.approle_secret_id = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.auth_method = approle {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.auth_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.kv_mountpoint = secret {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.kv_path = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.kv_version = 2 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.namespace = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.root_token_id = **** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.ssl_ca_crt_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.timeout = 60.0 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.token_file = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.token_role = None {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.use_ssl = False {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 21:33:10 devstack cinder-volume[86187]: DEBUG oslo_service.backend._eventlet.service [None req-f11bf6eb-7392-4a78-9489-c2c19d4cb9e5 None None] ******************************************************************************** {{(pid=86187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 21:33:10 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:33:10 devstack cinder-volume[86489]: INFO cinder.volume.driver [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Driver hasn't implemented _init_vendor_properties() Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.volume.driver [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.050682067871, 'free_capacity_gb': 1775.050682067871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86489) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_db.sqlalchemy.engines [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writer thread running {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.db.api [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Building query based on filter {{(pid=86489) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86489) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:33:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:33:10 devstack cinder-volume[86489]: INFO cinder.keymgr.migration [None req-6a1b02c9-bb10-45ba-8633-9d108f4da5d7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 21:33:10 devstack sudo[86513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:33:10 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:33:11 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.236s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:33:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Driver initialization completed successfully. Sep 28 21:33:11 devstack cinder-volume[86489]: INFO cinder.manager [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Initiating service 3 cleanup Sep 28 21:33:11 devstack cinder-volume[86489]: INFO cinder.manager [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Service 3 cleanup completed. Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG cinder.service [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Creating RPC server for service cinder-volume {{(pid=86489) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG cinder.service [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86489) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 21:33:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:33:11 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:33:11 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:33:11 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Sep 28 21:33:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:33:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5b498959-5571-41ed-8961-45dd4bc3a78e None None] Driver post RPC initialization completed successfully. Sep 28 21:33:20 devstack cinder-volume[86187]: DEBUG dbcounter [-] [86187] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:33:21 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:33:21 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=2 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:34:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:34:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 6 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:34:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:34:10 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Flow 'volume_create_manager' (ce3d3c7d-ef6e-419a-840e-d5cbeae3ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f14940-077e-4899-bc20-b0ade297d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f14940-077e-4899-bc20-b0ade297d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-402404860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de2dd09-d911-4236-bd36-f7baa3e86910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6602526e1d74ac5a392023a7c9204ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:34:11Z,use_quota=True,user_id='48739cf7e27340d29af296af57770211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903fc7b3-9abd-467f-911e-810bf443d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903fc7b3-9abd-467f-911e-810bf443d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7990387-92f4-4507-800b-b433a1ffcaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7990387-92f4-4507-800b-b433a1ffcaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de2dd09-d911-4236-bd36-f7baa3e86910', 'volume_name': 'volume-1de2dd09-d911-4236-bd36-f7baa3e86910', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff807e03-b9f1-4100-81d0-a3de27f713fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff807e03-b9f1-4100-81d0-a3de27f713fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9193f5-70e5-4555-bcd4-b7a7c50acd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Volume 1de2dd09-d911-4236-bd36-f7baa3e86910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de2dd09-d911-4236-bd36-f7baa3e86910', 'volume_size': 1} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-402404860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de2dd09-d911-4236-bd36-f7baa3e86910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6602526e1d74ac5a392023a7c9204ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:34:11Z,use_quota=True,user_id='48739cf7e27340d29af296af57770211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Creating volume 1de2dd09-d911-4236-bd36-f7baa3e86910 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:34:11 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:11 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 1073741824 Sep 28 21:34:11 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Flow 'volume_create_manager' (d085a8da-ecdb-4287-b84d-1ed38bb38181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1714ae60-a867-4ed6-adc5-ba1c5e3edb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1714ae60-a867-4ed6-adc5-ba1c5e3edb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-128810752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8b72aa-f518-4298-9538-fe3e71ac2295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d073353c769746f8b7b0da9af461c360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:34:11Z,use_quota=True,user_id='fcf1d44dbfc347799497a3874fe25a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374fb4ab-9de8-4032-b98a-459098946be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374fb4ab-9de8-4032-b98a-459098946be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f7cd91-739a-4db6-a886-e967fa95b97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f7cd91-739a-4db6-a886-e967fa95b97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8b72aa-f518-4298-9538-fe3e71ac2295', 'volume_name': 'volume-1d8b72aa-f518-4298-9538-fe3e71ac2295', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa619f07-292c-4a0f-b14b-113560211f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa619f07-292c-4a0f-b14b-113560211f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bf8126-9a1a-4384-bc51-bc17fb50ebc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:11 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Volume 1d8b72aa-f518-4298-9538-fe3e71ac2295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8b72aa-f518-4298-9538-fe3e71ac2295', 'volume_size': 1} Sep 28 21:34:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:12 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 1073741824" returned: 0 in 1.308s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:12 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 Sep 28 21:34:12 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:13 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910" returned: 0 in 0.539s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.353s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-128810752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8b72aa-f518-4298-9538-fe3e71ac2295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d073353c769746f8b7b0da9af461c360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:34:11Z,use_quota=True,user_id='fcf1d44dbfc347799497a3874fe25a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Creating volume 1d8b72aa-f518-4298-9538-fe3e71ac2295 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:34:13 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9193f5-70e5-4555-bcd4-b7a7c50acd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de2dd09-d911-4236-bd36-f7baa3e86910', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bc0c9a-e98b-4890-946d-94220358d5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:13 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 1073741824 Sep 28 21:34:13 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:13 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Volume volume-1de2dd09-d911-4236-bd36-f7baa3e86910 (1de2dd09-d911-4236-bd36-f7baa3e86910): created successfully Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bc0c9a-e98b-4890-946d-94220358d5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Flow 'volume_create_manager' (ce3d3c7d-ef6e-419a-840e-d5cbeae3ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:34:13 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-50c8e3b9-f152-49d4-9c1a-d93393dccd71 tempest-TaggedAttachmentsTest-820233508 None] Created volume successfully. Sep 28 21:34:14 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 1073741824" returned: 0 in 0.967s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:14 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 Sep 28 21:34:14 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:15 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295" returned: 0 in 0.819s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:34:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bf8126-9a1a-4384-bc51-bc17fb50ebc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8b72aa-f518-4298-9538-fe3e71ac2295', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b0e599-5357-4320-b8f9-3f2dac8b064c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:15 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Volume volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 (1d8b72aa-f518-4298-9538-fe3e71ac2295): created successfully Sep 28 21:34:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b0e599-5357-4320-b8f9-3f2dac8b064c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Flow 'volume_create_manager' (d085a8da-ecdb-4287-b84d-1ed38bb38181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:34:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-dfa07bc3-6ac9-4080-bcdd-f07735803344 tempest-DeleteServersTestJSON-441407699 None] Created volume successfully. Sep 28 21:34:21 devstack cinder-volume[86489]: WARNING py.warnings [req-7ee74d0a-880a-4504-9ab6-3db0f38857e1 req-1743d536-75aa-43f0-892e-b08f18da12ad tempest-DeleteServersTestJSON-441407699 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 21:34:21 devstack cinder-volume[86489]: .first() Sep 28 21:34:21 devstack cinder-volume[86489]: Sep 28 21:34:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7ee74d0a-880a-4504-9ab6-3db0f38857e1 req-1743d536-75aa-43f0-892e-b08f18da12ad tempest-DeleteServersTestJSON-441407699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7ee74d0a-880a-4504-9ab6-3db0f38857e1 req-1743d536-75aa-43f0-892e-b08f18da12ad tempest-DeleteServersTestJSON-441407699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7ee74d0a-880a-4504-9ab6-3db0f38857e1 req-1743d536-75aa-43f0-892e-b08f18da12ad tempest-DeleteServersTestJSON-441407699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7ee74d0a-880a-4504-9ab6-3db0f38857e1 req-1743d536-75aa-43f0-892e-b08f18da12ad tempest-DeleteServersTestJSON-441407699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-1d8b72aa-f518-4298-9538-fe3e71ac2295', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcf02f97-7636-45b9-9024-a541b858b106', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:34:21 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-7ee74d0a-880a-4504-9ab6-3db0f38857e1 req-1743d536-75aa-43f0-892e-b08f18da12ad tempest-DeleteServersTestJSON-441407699 None] attachment_update completed successfully. Sep 28 21:34:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-9cf01c28-9a4e-437b-9065-83044d4ff9d7 req-65c47b54-1b85-4205-b4bd-1cdd3cd7c1fc tempest-DeleteServersTestJSON-441407699 None] Terminate volume connection completed successfully. Sep 28 21:34:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-9cf01c28-9a4e-437b-9065-83044d4ff9d7 req-65c47b54-1b85-4205-b4bd-1cdd3cd7c1fc tempest-DeleteServersTestJSON-441407699 None] Deleting attachment fcf02f97-7636-45b9-9024-a541b858b106. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:34:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Acquiring lock "cinder-1d8b72aa-f518-4298-9538-fe3e71ac2295-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:34:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Lock "cinder-1d8b72aa-f518-4298-9538-fe3e71ac2295-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:34:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Acquiring lock "cinder-quobyte-1d8b72aa-f518-4298-9538-fe3e71ac2295" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:34:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Lock "cinder-quobyte-1d8b72aa-f518-4298-9538-fe3e71ac2295" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:34:31 devstack cinder-volume[86489]: INFO oslo.privsep.daemon [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpiz68ii1h/privsep.sock'] Sep 28 21:34:31 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpiz68ii1h/privsep.sock Sep 28 21:34:31 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 21:34:32 devstack cinder-volume[86489]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 21:34:32 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:32 devstack cinder-volume[86489]: INFO oslo.privsep.daemon [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Spawned new privsep daemon via rootwrap Sep 28 21:34:32 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Accepted privsep connection to /tmp/tmpiz68ii1h/privsep.sock {{(pid=86489) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 21:34:32 devstack cinder-volume[86489]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 21:34:32 devstack cinder-volume[86489]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 21:34:32 devstack cinder-volume[86489]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 21:34:32 devstack cinder-volume[86489]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88244 Sep 28 21:34:32 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d60561-ea22-4c6a-a344-95de5409a30e]: (2,) {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:34:33 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360325a-aa22-4eee-aca2-d4225f55a78a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:34:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:33 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 Sep 28 21:34:33 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:33 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295" returned: 0 in 0.439s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:33 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295 Sep 28 21:34:33 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:33 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1d8b72aa-f518-4298-9538-fe3e71ac2295" returned: 0 in 0.396s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Lock "cinder-quobyte-1d8b72aa-f518-4298-9538-fe3e71ac2295" released by "delete_volume" :: held 2.276s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:34:33 devstack cinder-volume[86489]: WARNING cinder.quota [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:34:33 devstack cinder-volume[86489]: WARNING cinder.quota [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Created reservations ['3b8496c0-0e06-4491-b4b2-a9eb9f39d4b5', 'f58a5a43-6521-449f-8bc5-1b07c2c12480', '90d6abf8-3d9b-4978-a378-879fba041a8a', '53c341a9-d666-421c-a2c9-2a23a7ac8741'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:34 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:34:34 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:34 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.268s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:34:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Deleted volume successfully. Sep 28 21:34:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e6ebd809-5676-48b9-a78c-b1586bdeab46 tempest-DeleteServersTestJSON-441407699 None] Lock "cinder-1d8b72aa-f518-4298-9538-fe3e71ac2295-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=18,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Flow 'volume_create_manager' (90de5dc8-4a3b-47ba-8bab-f57919e7541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfa40b0-0097-43e9-9fcf-1ee4c26b392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfa40b0-0097-43e9-9fcf-1ee4c26b392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-601495763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d22d7a-6a04-4b8e-b6e1-e71a14388d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5749100c3e64a41bec327bb673009c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:34:44Z,use_quota=True,user_id='d1a2ba56ac2f411e83be83f9f44f06ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a55c201-4842-4ddc-8a4f-40e0ccdde031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a55c201-4842-4ddc-8a4f-40e0ccdde031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632a9de0-6d8e-442f-90ef-40c19594ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632a9de0-6d8e-442f-90ef-40c19594ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d22d7a-6a04-4b8e-b6e1-e71a14388d76', 'volume_name': 'volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3e4ec7-0e5b-446a-a3ae-f623c47e9e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3e4ec7-0e5b-446a-a3ae-f623c47e9e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7139686-4a9f-4da0-a20f-ec49af86df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:44 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Volume 55d22d7a-6a04-4b8e-b6e1-e71a14388d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76', 'volume_size': 1} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-601495763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d22d7a-6a04-4b8e-b6e1-e71a14388d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5749100c3e64a41bec327bb673009c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:34:44Z,use_quota=True,user_id='d1a2ba56ac2f411e83be83f9f44f06ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Creating volume 55d22d7a-6a04-4b8e-b6e1-e71a14388d76 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:34:44 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:34:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:44 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 1073741824 Sep 28 21:34:44 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:45 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 1073741824" returned: 0 in 0.786s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:45 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 Sep 28 21:34:45 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:45 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76" returned: 0 in 0.397s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7139686-4a9f-4da0-a20f-ec49af86df1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a97658-e4ef-4db5-9edb-bb876f0c1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:45 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Volume volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 (55d22d7a-6a04-4b8e-b6e1-e71a14388d76): created successfully Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a97658-e4ef-4db5-9edb-bb876f0c1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Flow 'volume_create_manager' (90de5dc8-4a3b-47ba-8bab-f57919e7541a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:34:45 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ca7a4dcb-4357-45c4-9ca0-8d6c84971afe tempest-ServerActionsTestOtherA-493824196 None] Created volume successfully. Sep 28 21:34:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-962b780f-c215-4400-af12-a0c36ec801fa tempest-GroupSnapshotsV319Test-789194161 None] Group tempest-GroupSnapshotsV319Test-Group-1604824281: creating Sep 28 21:34:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-962b780f-c215-4400-af12-a0c36ec801fa tempest-GroupSnapshotsV319Test-789194161 None] Group tempest-GroupSnapshotsV319Test-Group-1604824281: created successfully Sep 28 21:34:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-962b780f-c215-4400-af12-a0c36ec801fa tempest-GroupSnapshotsV319Test-789194161 None] Create group completed successfully. Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Flow 'volume_create_manager' (24977137-102c-485a-9bfc-5f0158b7babd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60ce28f-83a4-4e3c-9439-55710b9231f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60ce28f-83a4-4e3c-9439-55710b9231f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-82314794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=806a9115-7a9c-48a7-b89f-84059be7faff,host='devstack@QuobyteHD#QuobyteHD',id=9babe1a2-25a2-4614-9de7-121b48e8a763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5350d6174d4c44b3be5c546da4583a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:34:54Z,use_quota=True,user_id='57bf95ce28c34d80a71695a4f074df15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8ad0a66-a656-4794-9f8e-a0cf73cae764),volume_type_id=e8ad0a66-a656-4794-9f8e-a0cf73cae764)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85db305d-f3f6-4499-9c0b-14ea45e9a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85db305d-f3f6-4499-9c0b-14ea45e9a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a55565e-917a-4729-bb33-82c3705143e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a55565e-917a-4729-bb33-82c3705143e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9babe1a2-25a2-4614-9de7-121b48e8a763', 'volume_name': 'volume-9babe1a2-25a2-4614-9de7-121b48e8a763', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f3ec47-a2de-402f-af27-411ab7c8065b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f3ec47-a2de-402f-af27-411ab7c8065b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3221a9-207a-4a12-b28b-6b74ee418902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:54 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Volume 9babe1a2-25a2-4614-9de7-121b48e8a763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9babe1a2-25a2-4614-9de7-121b48e8a763', 'volume_size': 1} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=806a9115-7a9c-48a7-b89f-84059be7faff,created_at=2026-09-28T19:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-82314794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=806a9115-7a9c-48a7-b89f-84059be7faff,host='devstack@QuobyteHD#QuobyteHD',id=9babe1a2-25a2-4614-9de7-121b48e8a763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5350d6174d4c44b3be5c546da4583a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:34:54Z,use_quota=True,user_id='57bf95ce28c34d80a71695a4f074df15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8ad0a66-a656-4794-9f8e-a0cf73cae764),volume_type_id=e8ad0a66-a656-4794-9f8e-a0cf73cae764)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Creating volume 9babe1a2-25a2-4614-9de7-121b48e8a763 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:34:54 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:34:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:54 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 1073741824 Sep 28 21:34:54 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:55 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 1073741824" returned: 0 in 0.892s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:55 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 Sep 28 21:34:55 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:55 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763" returned: 0 in 0.616s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:55 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:34:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:34:55 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3221a9-207a-4a12-b28b-6b74ee418902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9babe1a2-25a2-4614-9de7-121b48e8a763', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:55 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8cca58-2106-478b-b1c2-54d96bd4ff79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:34:56 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Volume volume-9babe1a2-25a2-4614-9de7-121b48e8a763 (9babe1a2-25a2-4614-9de7-121b48e8a763): created successfully Sep 28 21:34:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8cca58-2106-478b-b1c2-54d96bd4ff79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:34:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Flow 'volume_create_manager' (24977137-102c-485a-9bfc-5f0158b7babd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:34:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c565f0c8-74c2-4ea1-9191-cadc537cf743 tempest-GroupSnapshotsV319Test-789194161 None] Created volume successfully. Sep 28 21:34:57 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] GroupSnapshot 13563a3d-b91c-41f9-82c2-7aa4981818f5: creating. Sep 28 21:34:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Group snapshot 13563a3d-b91c-41f9-82c2-7aa4981818f5: creating. {{(pid=86489) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 21:34:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:34:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:34:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Creating offline snapshot 6d5bc39a-00d5-4cda-9e59-bdd00e5f624d of volume 9babe1a2-25a2-4614-9de7-121b48e8a763 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:34:57 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d5c4f3-391d-460c-bffb-810ad5aefd09]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:34:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:57 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 Sep 28 21:34:57 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:58 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763" returned: 0 in 0.466s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:58 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d 1G Sep 28 21:34:58 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:58 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d 1G" returned: 0 in 0.624s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9babe1a2-25a2-4614-9de7-121b48e8a763 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:58 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9babe1a2-25a2-4614-9de7-121b48e8a763 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d Sep 28 21:34:58 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:59 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9babe1a2-25a2-4614-9de7-121b48e8a763 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d" returned: 0 in 0.585s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:59 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:34:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:34:59 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d Sep 28 21:34:59 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:34:59 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Sep 28 21:34:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d" returned: 0 in 0.577s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:34:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:00 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.info Sep 28 21:35:00 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:00 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.info" returned: 0 in 0.337s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:00 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:35:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:00 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.info Sep 28 21:35:00 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:00 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.info" returned: 0 in 0.392s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d7f919e2-7bf0-4186-b467-48101d30df37 tempest-GroupSnapshotsV319Test-789194161 None] group_snapshot 13563a3d-b91c-41f9-82c2-7aa4981818f5: created successfully Sep 28 21:35:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] group_snapshot 13563a3d-b91c-41f9-82c2-7aa4981818f5: deleting Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] group_snapshot 13563a3d-b91c-41f9-82c2-7aa4981818f5: deleting {{(pid=86489) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Acquiring lock "cinder-quobyte-9babe1a2-25a2-4614-9de7-121b48e8a763" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Lock "cinder-quobyte-9babe1a2-25a2-4614-9de7-121b48e8a763" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Acquiring lock "cinder-quobyte-6d5bc39a-00d5-4cda-9e59-bdd00e5f624d" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Lock "cinder-quobyte-6d5bc39a-00d5-4cda-9e59-bdd00e5f624d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Deleting offline snapshot 6d5bc39a-00d5-4cda-9e59-bdd00e5f624d of volume 9babe1a2-25a2-4614-9de7-121b48e8a763 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] snapshot_file for this snap is: volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335de29-a484-46e4-a71b-3bbfa805e322]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:02 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d Sep 28 21:35:02 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:02 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d" returned: 0 in 0.619s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9babe1a2-25a2-4614-9de7-121b48e8a763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c3ba9a-c014-46f0-99a9-be9cd0acc301]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:35:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:03 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 Sep 28 21:35:03 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:03 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763" returned: 0 in 0.521s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:03 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d Sep 28 21:35:03 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:03 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d" returned: 0 in 0.373s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:03 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d Sep 28 21:35:03 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:04 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763.6d5bc39a-00d5-4cda-9e59-bdd00e5f624d" returned: 0 in 0.294s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Lock "cinder-quobyte-6d5bc39a-00d5-4cda-9e59-bdd00e5f624d" released by "_delete_snapshot" :: held 1.995s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:35:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Lock "cinder-quobyte-9babe1a2-25a2-4614-9de7-121b48e8a763" released by "delete_snapshot" :: held 2.026s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:35:04 devstack cinder-volume[86489]: WARNING cinder.quota [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1928557413 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1928557413, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:35:04 devstack cinder-volume[86489]: WARNING cinder.quota [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1928557413 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1928557413, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:35:04 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] Created reservations ['7b6102f5-3174-4580-be88-ab1958c94db4', '49562532-9d59-4099-89f6-5c7846366d7c', '5722700e-7867-4a36-ad56-73aed8924ded', '940d0285-6146-44ca-a33b-1e4f6c6f2ec1'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:35:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0075f406-bc2f-47f4-87bd-aa1556d87ef1 tempest-GroupSnapshotsV319Test-789194161 None] group_snapshot 13563a3d-b91c-41f9-82c2-7aa4981818f5: deleted successfully Sep 28 21:35:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Acquiring lock "cinder-quobyte-9babe1a2-25a2-4614-9de7-121b48e8a763" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Lock "cinder-quobyte-9babe1a2-25a2-4614-9de7-121b48e8a763" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:06 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9804d1-cb86-4f5a-9785-b2129de34342]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:35:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:06 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 Sep 28 21:35:06 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:06 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763" returned: 0 in 0.495s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:06 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763 Sep 28 21:35:06 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:07 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9babe1a2-25a2-4614-9de7-121b48e8a763" returned: 0 in 0.421s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Lock "cinder-quobyte-9babe1a2-25a2-4614-9de7-121b48e8a763" released by "delete_volume" :: held 1.123s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Created reservations ['5a0a6651-4efa-41a0-8cce-9349b5eb8a2e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:35:07 devstack cinder-volume[86489]: WARNING cinder.quota [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1928557413 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1928557413, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Created reservations ['e79cf471-9528-405f-b469-2e92e5d42c9d', 'e04cb957-0453-4d9b-9bc9-b71f390c0378', 'a0f5ca3e-49bc-4b1e-a592-96f5442beb10', 'b4bdcc54-fae7-46e1-817e-77239912721d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:07 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:35:07 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:07 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:35:07 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:08 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.577s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:35:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c560759e-1fea-482e-8a21-af870187c486 tempest-GroupSnapshotsV319Test-789194161 None] Delete group completed successfully. Sep 28 21:35:08 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.831s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:35:08 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:35:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 8 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:35:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:35:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-c91351be-fc1c-4616-97a8-6d6b0aa1e586 req-0de5259e-6a17-4e50-8db5-217ce8cbf086 tempest-TaggedAttachmentsTest-820233508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-c91351be-fc1c-4616-97a8-6d6b0aa1e586 req-0de5259e-6a17-4e50-8db5-217ce8cbf086 tempest-TaggedAttachmentsTest-820233508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-c91351be-fc1c-4616-97a8-6d6b0aa1e586 req-0de5259e-6a17-4e50-8db5-217ce8cbf086 tempest-TaggedAttachmentsTest-820233508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-c91351be-fc1c-4616-97a8-6d6b0aa1e586 req-0de5259e-6a17-4e50-8db5-217ce8cbf086 tempest-TaggedAttachmentsTest-820233508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-1de2dd09-d911-4236-bd36-f7baa3e86910', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90336a74-f8be-4f7c-b24e-ad8d55501a22', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:35:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-c91351be-fc1c-4616-97a8-6d6b0aa1e586 req-0de5259e-6a17-4e50-8db5-217ce8cbf086 tempest-TaggedAttachmentsTest-820233508 None] attachment_update completed successfully. Sep 28 21:35:11 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=45,cinder:INSERT=10,cinder:UPDATE=44,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:35:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-cda76d83-c349-4dd2-88f7-fb571e64364e req-3069ce5e-8f5c-430d-a6ce-c4afdcd4d9a4 tempest-TaggedAttachmentsTest-820233508 None] Terminate volume connection completed successfully. Sep 28 21:35:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-cda76d83-c349-4dd2-88f7-fb571e64364e req-3069ce5e-8f5c-430d-a6ce-c4afdcd4d9a4 tempest-TaggedAttachmentsTest-820233508 None] Deleting attachment 90336a74-f8be-4f7c-b24e-ad8d55501a22. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:35:25 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=39,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:35:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Acquiring lock "cinder-1de2dd09-d911-4236-bd36-f7baa3e86910-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Lock "cinder-1de2dd09-d911-4236-bd36-f7baa3e86910-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Acquiring lock "cinder-quobyte-1de2dd09-d911-4236-bd36-f7baa3e86910" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Lock "cinder-quobyte-1de2dd09-d911-4236-bd36-f7baa3e86910" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:27 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe997a0-dfd3-484c-85cc-32f02c69e730]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:35:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:27 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 Sep 28 21:35:27 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:27 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910" returned: 0 in 0.421s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:27 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910 Sep 28 21:35:27 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:28 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1de2dd09-d911-4236-bd36-f7baa3e86910" returned: 0 in 0.295s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Lock "cinder-quobyte-1de2dd09-d911-4236-bd36-f7baa3e86910" released by "delete_volume" :: held 0.769s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Created reservations ['e5a5163d-094a-469f-af14-4f78e98eae22', 'd68e8e0f-b651-4798-9f0f-7a6718a39734', '206d072b-24aa-4c15-99c2-52d2477485ac', 'f05c2c56-1dbc-47a4-8c82-57dde37270e0'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:28 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:35:28 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:28 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:35:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Deleted volume successfully. Sep 28 21:35:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-93ac4f7a-d01f-41c4-aa7b-9d947acd57c9 tempest-TaggedAttachmentsTest-820233508 None] Lock "cinder-1de2dd09-d911-4236-bd36-f7baa3e86910-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:35:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-245348e1-3b5e-4f78-bbde-87fac921bf63 req-bab4e135-4180-4e54-b742-48c2174284af tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-245348e1-3b5e-4f78-bbde-87fac921bf63 req-bab4e135-4180-4e54-b742-48c2174284af tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-245348e1-3b5e-4f78-bbde-87fac921bf63 req-bab4e135-4180-4e54-b742-48c2174284af tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-245348e1-3b5e-4f78-bbde-87fac921bf63 req-bab4e135-4180-4e54-b742-48c2174284af tempest-ServerActionsTestOtherA-493824196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b94695b-9e2a-41d2-8d24-79c9d9ef1a1c', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:35:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-245348e1-3b5e-4f78-bbde-87fac921bf63 req-bab4e135-4180-4e54-b742-48c2174284af tempest-ServerActionsTestOtherA-493824196 None] attachment_update completed successfully. Sep 28 21:35:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-4f7b6778-d05c-4263-94da-7d778cd9b59d req-dd1a1903-18da-4158-b665-962a7a8ec45c tempest-ServerActionsTestOtherA-493824196 None] Terminate volume connection completed successfully. Sep 28 21:35:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-4f7b6778-d05c-4263-94da-7d778cd9b59d req-dd1a1903-18da-4158-b665-962a7a8ec45c tempest-ServerActionsTestOtherA-493824196 None] Deleting attachment 1b94695b-9e2a-41d2-8d24-79c9d9ef1a1c. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:35:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-4f7b6778-d05c-4263-94da-7d778cd9b59d req-170b021c-bfc7-448d-aaa4-c6e83e829e90 tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-4f7b6778-d05c-4263-94da-7d778cd9b59d req-170b021c-bfc7-448d-aaa4-c6e83e829e90 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-4f7b6778-d05c-4263-94da-7d778cd9b59d req-170b021c-bfc7-448d-aaa4-c6e83e829e90 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-4f7b6778-d05c-4263-94da-7d778cd9b59d req-170b021c-bfc7-448d-aaa4-c6e83e829e90 tempest-ServerActionsTestOtherA-493824196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20843963-8126-4e47-97d1-b84d9aa4bef5', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:35:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-4f7b6778-d05c-4263-94da-7d778cd9b59d req-170b021c-bfc7-448d-aaa4-c6e83e829e90 tempest-ServerActionsTestOtherA-493824196 None] attachment_update completed successfully. Sep 28 21:35:39 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:35:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Flow 'volume_create_manager' (bf81d26b-c593-4bb2-b33d-b54b1e4b23d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:35:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83166efa-9dd1-4ae5-842b-1a049f7e5cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83166efa-9dd1-4ae5-842b-1a049f7e5cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1256957847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd9ce0c-1655-4cb0-803c-e81d51e39e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f3e350d9e64afda77017785e7054eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:35:40Z,use_quota=True,user_id='7808f43e35594b0eb57b0417843949df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488fcf9e-c489-46bf-aa33-010bcbf42c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488fcf9e-c489-46bf-aa33-010bcbf42c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8655b4d-e25a-44f0-96b6-1d2e1a7d189a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8655b4d-e25a-44f0-96b6-1d2e1a7d189a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd9ce0c-1655-4cb0-803c-e81d51e39e57', 'volume_name': 'volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8dfbf4-1c0c-4b35-b905-a818c793298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8dfbf4-1c0c-4b35-b905-a818c793298d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68f9254-87fe-42e9-9e88-561a0394c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:40 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Volume 8dd9ce0c-1655-4cb0-803c-e81d51e39e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57', 'volume_size': 1} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1256957847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd9ce0c-1655-4cb0-803c-e81d51e39e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f3e350d9e64afda77017785e7054eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:35:40Z,use_quota=True,user_id='7808f43e35594b0eb57b0417843949df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Creating volume 8dd9ce0c-1655-4cb0-803c-e81d51e39e57 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:35:40 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:35:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:40 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 1073741824 Sep 28 21:35:40 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:41 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 1073741824" returned: 0 in 1.125s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:41 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 Sep 28 21:35:41 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:41 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57" returned: 0 in 0.693s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:35:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68f9254-87fe-42e9-9e88-561a0394c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcfabcc-b006-4d76-b8d0-c04d7baff761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:42 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Volume volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 (8dd9ce0c-1655-4cb0-803c-e81d51e39e57): created successfully Sep 28 21:35:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcfabcc-b006-4d76-b8d0-c04d7baff761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Flow 'volume_create_manager' (bf81d26b-c593-4bb2-b33d-b54b1e4b23d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:35:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-75f2abc0-c816-4dae-9281-84ddcfeeaeda tempest-VolumesAdminNegativeTest-1036232019 None] Created volume successfully. Sep 28 21:35:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Acquiring lock "cinder-8dd9ce0c-1655-4cb0-803c-e81d51e39e57-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Lock "cinder-8dd9ce0c-1655-4cb0-803c-e81d51e39e57-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Acquiring lock "cinder-quobyte-8dd9ce0c-1655-4cb0-803c-e81d51e39e57" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Lock "cinder-quobyte-8dd9ce0c-1655-4cb0-803c-e81d51e39e57" acquired by "delete_volume" :: waited 0.082s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:44 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b8299e-48ac-4564-a820-bc4f2b980504]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:35:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:45 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 Sep 28 21:35:45 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:45 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57" returned: 0 in 1.125s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:45 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57 Sep 28 21:35:45 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:46 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8dd9ce0c-1655-4cb0-803c-e81d51e39e57" returned: 0 in 0.359s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Lock "cinder-quobyte-8dd9ce0c-1655-4cb0-803c-e81d51e39e57" released by "delete_volume" :: held 1.611s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Created reservations ['093eb5e9-8327-4ac0-a79e-661b935e12d8', '728a3b0f-e577-41fc-9b23-47cb0208cef5', '29d8f677-161f-4726-b7e1-0e5c1968be0d', 'e98594db-a263-46a5-93b8-4777bc0d8b0c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:46 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:35:46 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:46 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.375s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:35:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Deleted volume successfully. Sep 28 21:35:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b17871f9-0cb5-4c08-845e-06d5e9ce6f1e tempest-VolumesAdminNegativeTest-1036232019 None] Lock "cinder-8dd9ce0c-1655-4cb0-803c-e81d51e39e57-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Flow 'volume_create_manager' (9efbb886-47bb-4b76-b772-d7c667fdfa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2748e6ab-7a36-4ac1-908f-205df4e3bc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2748e6ab-7a36-4ac1-908f-205df4e3bc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1641549165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d566f6-da5f-438c-b33e-366f8a3fa45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c4797bf2d48f48ad174143875b574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:35:51Z,use_quota=True,user_id='0d1c8f429f4549f5813af90c9fcd685e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765bec80-83e1-41c7-a9f7-204d860cd0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765bec80-83e1-41c7-a9f7-204d860cd0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea60763-2983-4422-a2da-7286fb37ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea60763-2983-4422-a2da-7286fb37ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d566f6-da5f-438c-b33e-366f8a3fa45c', 'volume_name': 'volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0d4c03-a3be-4e3b-bb5c-b3b95ffd5d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0d4c03-a3be-4e3b-bb5c-b3b95ffd5d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de828df4-c89c-41d0-a224-4c766da8770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:51 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Volume f4d566f6-da5f-438c-b33e-366f8a3fa45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c', 'volume_size': 1} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1641549165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d566f6-da5f-438c-b33e-366f8a3fa45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c4797bf2d48f48ad174143875b574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:35:51Z,use_quota=True,user_id='0d1c8f429f4549f5813af90c9fcd685e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Creating volume f4d566f6-da5f-438c-b33e-366f8a3fa45c {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:35:51 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:35:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:51 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c 1073741824 Sep 28 21:35:51 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:52 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c 1073741824" returned: 0 in 0.656s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:52 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c Sep 28 21:35:52 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:52 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de828df4-c89c-41d0-a224-4c766da8770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067e08e3-33ce-4e55-a3a7-c05a81c2dc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:35:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Volume volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c (f4d566f6-da5f-438c-b33e-366f8a3fa45c): created successfully Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067e08e3-33ce-4e55-a3a7-c05a81c2dc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:35:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Flow 'volume_create_manager' (9efbb886-47bb-4b76-b772-d7c667fdfa91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:35:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bb4b8212-30a1-4584-90d7-27bc54800cb1 tempest-SnapshotMetadataTestJSON-157801157 None] Created volume successfully. Sep 28 21:35:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:35:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:35:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Creating offline snapshot c3a16290-deeb-4c4e-a489-f42fbaccac00 of volume f4d566f6-da5f-438c-b33e-366f8a3fa45c {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:35:53 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c9e6d2-892d-4d9e-b75d-50ab68babbf2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:35:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:53 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c Sep 28 21:35:53 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:54 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c" returned: 0 in 0.448s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:54 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 1G Sep 28 21:35:54 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:54 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 1G" returned: 0 in 0.477s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:54 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 Sep 28 21:35:54 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:55 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00" returned: 0 in 0.440s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:55 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 is being set with open permissions: ugo+rw Sep 28 21:35:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:55 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 Sep 28 21:35:55 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:55 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:55 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.info Sep 28 21:35:55 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:55 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.info" returned: 0 in 0.313s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:55 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.info is being set with open permissions: ugo+rw Sep 28 21:35:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:55 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.info Sep 28 21:35:55 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:56 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.info" returned: 0 in 0.332s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:35:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8bb40e2c-1109-4906-9485-48e96c74c060 tempest-SnapshotMetadataTestJSON-157801157 None] Create snapshot completed successfully Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "cinder-c3a16290-deeb-4c4e-a489-f42fbaccac00-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-c3a16290-deeb-4c4e-a489-f42fbaccac00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "cinder-quobyte-f4d566f6-da5f-438c-b33e-366f8a3fa45c" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-quobyte-f4d566f6-da5f-438c-b33e-366f8a3fa45c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "cinder-quobyte-c3a16290-deeb-4c4e-a489-f42fbaccac00" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-quobyte-c3a16290-deeb-4c4e-a489-f42fbaccac00" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Deleting offline snapshot c3a16290-deeb-4c4e-a489-f42fbaccac00 of volume f4d566f6-da5f-438c-b33e-366f8a3fa45c {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] snapshot_file for this snap is: volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ab01a-6318-418e-af00-37184a968535]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:58 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 Sep 28 21:35:58 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:58 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00" returned: 0 in 0.478s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e104fd-2455-43f4-96eb-092e0d53cb60]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:35:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:59 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c Sep 28 21:35:59 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:59 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c" returned: 0 in 0.466s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:59 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 Sep 28 21:35:59 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:59 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00" returned: 0 in 0.378s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:35:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:35:59 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00 Sep 28 21:35:59 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:35:59 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Sep 28 21:35:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c.c3a16290-deeb-4c4e-a489-f42fbaccac00" returned: 0 in 0.273s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-quobyte-c3a16290-deeb-4c4e-a489-f42fbaccac00" released by "_delete_snapshot" :: held 1.823s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-quobyte-f4d566f6-da5f-438c-b33e-366f8a3fa45c" released by "delete_snapshot" :: held 1.887s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:00 devstack cinder-volume[86489]: WARNING cinder.quota [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Created reservations ['111b0b62-334d-4193-92ce-e9e7c15506ba', '6402f941-1072-4319-b7b0-b1438fd47dfd', 'edfb027c-28b3-413b-a3d6-dac99aa44b86', '0dde5725-d7b8-48e1-8b80-103992969437'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:36:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Delete snapshot completed successfully. Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-21a68452-54d0-497e-a0d2-2cb7e853a8e8 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-c3a16290-deeb-4c4e-a489-f42fbaccac00-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "cinder-f4d566f6-da5f-438c-b33e-366f8a3fa45c-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-f4d566f6-da5f-438c-b33e-366f8a3fa45c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "cinder-quobyte-f4d566f6-da5f-438c-b33e-366f8a3fa45c" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-quobyte-f4d566f6-da5f-438c-b33e-366f8a3fa45c" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed5d88f-ca5b-4ac9-85df-9a11e3af8261]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:00 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c Sep 28 21:36:00 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:01 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c" returned: 0 in 0.478s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:01 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c Sep 28 21:36:01 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:01 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4d566f6-da5f-438c-b33e-366f8a3fa45c" returned: 0 in 0.287s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-quobyte-f4d566f6-da5f-438c-b33e-366f8a3fa45c" released by "delete_volume" :: held 0.865s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Created reservations ['492404f8-2b02-4498-a925-f660e74dc600', '9195707d-ee92-4aba-913a-757f8adeca8f', '5e47c664-cbf3-4e2f-a8c6-97ff510303c5', '33cb25a0-0628-4a58-88e4-dfd4299ad1ee'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:01 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:36:01 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:01 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.323s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:36:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Deleted volume successfully. Sep 28 21:36:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-50cecb6e-19f8-431d-a385-089eb3e50b00 tempest-SnapshotMetadataTestJSON-157801157 None] Lock "cinder-f4d566f6-da5f-438c-b33e-366f8a3fa45c-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:36:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:07 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:36:07 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:08 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.568s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:36:08 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:36:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 8 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:36:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Flow 'volume_create_manager' (7c15e37a-3159-4fe9-a9b0-85b990dd1c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403ca4f3-c528-4b57-a02d-a73e1a92a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403ca4f3-c528-4b57-a02d-a73e1a92a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-351025132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00adb8fa-8765-4f1d-935c-576f8df4c1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8090d550e7450bb51194bc5ff070c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:09Z,use_quota=True,user_id='56823ae256fa40ee9646bb9cfb8224f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75341abc-6f5a-49ec-ad7b-9afe6a2b9e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75341abc-6f5a-49ec-ad7b-9afe6a2b9e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7715ec41-477e-4941-bdfd-a267a407089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7715ec41-477e-4941-bdfd-a267a407089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00adb8fa-8765-4f1d-935c-576f8df4c1b2', 'volume_name': 'volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d087e6a-11a5-44d2-9885-9e04d30d42b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d087e6a-11a5-44d2-9885-9e04d30d42b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e085ee-f802-4987-b283-508059381029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:09 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Volume 00adb8fa-8765-4f1d-935c-576f8df4c1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2', 'volume_size': 1} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-351025132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00adb8fa-8765-4f1d-935c-576f8df4c1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8090d550e7450bb51194bc5ff070c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:09Z,use_quota=True,user_id='56823ae256fa40ee9646bb9cfb8224f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Creating volume 00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:36:09 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:09 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 1073741824 Sep 28 21:36:09 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:09 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 1073741824" returned: 0 in 0.646s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-13c3cfd5-8a0e-42d4-a9a8-712ac6b91569 req-0a1d7f86-a8c3-42fb-99e1-addbf5d5ed25 tempest-ServerActionsTestOtherA-493824196 None] Terminate volume connection completed successfully. Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-13c3cfd5-8a0e-42d4-a9a8-712ac6b91569 req-0a1d7f86-a8c3-42fb-99e1-addbf5d5ed25 tempest-ServerActionsTestOtherA-493824196 None] Deleting attachment 20843963-8126-4e47-97d1-b84d9aa4bef5. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:10 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 Sep 28 21:36:10 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:10 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2" returned: 0 in 0.302s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e085ee-f802-4987-b283-508059381029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae0c55a-ee44-4c92-bb80-5511bc7f9362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:10 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Volume volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 (00adb8fa-8765-4f1d-935c-576f8df4c1b2): created successfully Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae0c55a-ee44-4c92-bb80-5511bc7f9362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Flow 'volume_create_manager' (7c15e37a-3159-4fe9-a9b0-85b990dd1c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-4fe6e090-adfb-4300-9a7d-a6d3cef4c158 tempest-VolumesDeleteCascade-621532363 None] Created volume successfully. Sep 28 21:36:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Creating offline snapshot f3b17a6f-caf0-4b55-901c-0eb97ad97449 of volume 00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:36:11 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e43eb4-e008-49af-a52c-1e3fdf11ae36]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:11 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 Sep 28 21:36:11 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:12 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2" returned: 0 in 0.592s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:12 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 1G Sep 28 21:36:12 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:12 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 1G" returned: 0 in 0.539s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:12 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 Sep 28 21:36:12 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:13 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449" returned: 0 in 0.401s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:13 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 is being set with open permissions: ugo+rw Sep 28 21:36:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:13 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 Sep 28 21:36:13 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:13 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449" returned: 0 in 0.262s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:13 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.info Sep 28 21:36:13 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:13 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.info" returned: 0 in 0.346s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:13 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.info is being set with open permissions: ugo+rw Sep 28 21:36:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:14 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.info Sep 28 21:36:14 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:14 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.info" returned: 0 in 0.304s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:14 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2f2f643b-2501-4064-b2fb-485d1ad67b90 tempest-VolumesDeleteCascade-621532363 None] Create snapshot completed successfully Sep 28 21:36:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Creating offline snapshot f2da9b9c-e958-478d-babc-e3a56c32627a of volume 00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:36:15 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c99f820-bc95-4cef-9019-81cd2f4a9d3b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:15 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 Sep 28 21:36:15 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:16 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449" returned: 0 in 0.734s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:36:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:16 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a 1G Sep 28 21:36:16 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:16 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a 1G" returned: 0 in 0.863s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:17 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a Sep 28 21:36:17 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:17 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a" returned: 0 in 0.433s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:17 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a is being set with open permissions: ugo+rw Sep 28 21:36:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:17 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a Sep 28 21:36:17 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:17 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a" returned: 0 in 0.327s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-87b689d7-1ebf-4a70-8e14-d69208b550a8 tempest-VolumesDeleteCascade-621532363 None] Create snapshot completed successfully Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-00adb8fa-8765-4f1d-935c-576f8df4c1b2-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-00adb8fa-8765-4f1d-935c-576f8df4c1b2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Performing cascade delete. {{(pid=86489) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-f2da9b9c-e958-478d-babc-e3a56c32627a-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-f2da9b9c-e958-478d-babc-e3a56c32627a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-f2da9b9c-e958-478d-babc-e3a56c32627a" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-f2da9b9c-e958-478d-babc-e3a56c32627a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Deleting offline snapshot f2da9b9c-e958-478d-babc-e3a56c32627a of volume 00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] snapshot_file for this snap is: volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a5359-5134-4056-825a-029aa8687d31]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:19 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a Sep 28 21:36:19 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:19 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a" returned: 0 in 0.659s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:36:19 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ad3df7-c772-46c5-9527-1a77dd7f7f8d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:19 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 Sep 28 21:36:19 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Flow 'volume_create_manager' (9fb38fcd-a2f4-483e-bc3b-5d029fe7d154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59b2bcc-42b7-4bd9-a190-48980ec16515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59b2bcc-42b7-4bd9-a190-48980ec16515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-957670037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac27c97-3ce7-4597-be04-757a927f2ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5749100c3e64a41bec327bb673009c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:20Z,use_quota=True,user_id='d1a2ba56ac2f411e83be83f9f44f06ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70362cb9-0fd0-4ed1-8a95-7b70134f0b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70362cb9-0fd0-4ed1-8a95-7b70134f0b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c45562b-174d-4f46-b5a0-3bdb582d4c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:36:20 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449" returned: 0 in 0.804s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:36:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:20 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a Sep 28 21:36:20 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:21 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a" returned: 0 in 0.750s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:21 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a Sep 28 21:36:21 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c45562b-174d-4f46-b5a0-3bdb582d4c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cac27c97-3ce7-4597-be04-757a927f2ce8', 'volume_name': 'volume-cac27c97-3ce7-4597-be04-757a927f2ce8', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1b25a0-33df-428e-856a-8c98dd62443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1b25a0-33df-428e-856a-8c98dd62443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e9c4d6-8acb-4de5-ba8e-d8b7c0712fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Volume cac27c97-3ce7-4597-be04-757a927f2ce8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cac27c97-3ce7-4597-be04-757a927f2ce8', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Trying to clone cac27c97-3ce7-4597-be04-757a927f2ce8 from image 3995c6d3-b961-4789-8642-3546544acbf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:36:21 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f2da9b9c-e958-478d-babc-e3a56c32627a" returned: 0 in 0.445s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-f2da9b9c-e958-478d-babc-e3a56c32627a" released by "_delete_snapshot" :: held 2.933s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" released by "delete_snapshot" :: held 2.992s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:21 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=49,cinder:UPDATE=48,cinder:INSERT=7,cinder:DELETE=6 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Created reservations ['30075a7f-adc2-49d6-9e18-6e1583c5d494', 'f8b78e2a-70d1-44d8-b7cc-acec10e84593', 'f929eeca-aeb3-45dc-8974-d036dd089bfa', '1906aa87-844d-4338-a2bf-abfd3f0f15df'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:36:22 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Image download 20.69 MB at 20.69 MB/s Sep 28 21:36:22 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Delete snapshot completed successfully. Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-f2da9b9c-e958-478d-babc-e3a56c32627a-delete_snapshot" released by "delete_snapshot" :: held 3.507s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-f3b17a6f-caf0-4b55-901c-0eb97ad97449-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-f3b17a6f-caf0-4b55-901c-0eb97ad97449-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a3c353-1156-47cb-9dd0-d3d5dc2039fc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-f3b17a6f-caf0-4b55-901c-0eb97ad97449" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-f3b17a6f-caf0-4b55-901c-0eb97ad97449" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Deleting offline snapshot f3b17a6f-caf0-4b55-901c-0eb97ad97449 of volume 00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] snapshot_file for this snap is: volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e3f24f-9ec2-4a37-bd5c-c6ad03b7f47e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:22 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD Sep 28 21:36:22 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:22 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 Sep 28 21:36:22 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:22 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD" returned: 0 in 0.605s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 is fetched for user d1a2ba56ac2f411e83be83f9f44f06ba. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:36:22 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449" returned: 0 in 0.493s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d0ee6a-0b07-4760-b933-cf4081acba40]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea8aa39-ec50-4b3e-80b0-3faa94ad0904]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:23 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 Sep 28 21:36:23 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:23 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD Sep 28 21:36:23 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:23 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2" returned: 0 in 0.499s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:23 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-957670037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac27c97-3ce7-4597-be04-757a927f2ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5749100c3e64a41bec327bb673009c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:20Z,use_quota=True,user_id='d1a2ba56ac2f411e83be83f9f44f06ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Creating volume cac27c97-3ce7-4597-be04-757a927f2ce8 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:36:23 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:36:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:23 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 Sep 28 21:36:23 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:23 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 1073741824 Sep 28 21:36:23 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:24 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449" returned: 0 in 0.602s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:24 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449 Sep 28 21:36:24 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:24 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 1073741824" returned: 0 in 0.636s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:24 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 Sep 28 21:36:24 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:24 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Attempting download of 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume cac27c97-3ce7-4597-be04-757a927f2ce8. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:36:24 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2.f3b17a6f-caf0-4b55-901c-0eb97ad97449" returned: 0 in 0.479s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3b2d2e-d5f0-4dbf-b889-df6236520360]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_kdprw0v5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-f3b17a6f-caf0-4b55-901c-0eb97ad97449" released by "_delete_snapshot" :: held 2.267s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" released by "delete_snapshot" :: held 2.315s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Created reservations ['b782d623-17a7-4e06-bdfa-22b8e1b9e698', 'e2a010d5-f37c-4d9f-b28f-a8105ce44a0b', '1dfa4c6a-cec5-491e-a63a-132cf9aa94e1', 'dc3643e4-53ac-48c3-aae2-f575e95335c6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:36:24 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_kdprw0v5 Sep 28 21:36:24 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:24 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Delete snapshot completed successfully. Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-f3b17a6f-caf0-4b55-901c-0eb97ad97449-delete_snapshot" released by "delete_snapshot" :: held 2.584s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Snapshots deleted, issuing volume delete {{(pid=86489) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" acquired by "delete_volume" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb12704-c1a1-433f-a223-88252668da18]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:25 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_kdprw0v5" returned: 0 in 0.469s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_kdprw0v5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:25 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 Sep 28 21:36:25 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:25 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_kdprw0v5 Sep 28 21:36:25 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:25 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2" returned: 0 in 0.528s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:25 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2 Sep 28 21:36:25 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:25 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_kdprw0v5" returned: 1 in 0.522s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_kdprw0v5' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff84e3-15db-4c99-87d8-093af4885ae2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:25 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD Sep 28 21:36:25 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:25 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-00adb8fa-8765-4f1d-935c-576f8df4c1b2" returned: 0 in 0.383s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-00adb8fa-8765-4f1d-935c-576f8df4c1b2" released by "delete_volume" :: held 1.015s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:25 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=72,cinder:INSERT=19,cinder:UPDATE=60,cinder:DELETE=3 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Created reservations ['376c8c7b-1113-4ab0-8e24-a98d2c0aea24', 'ebf76918-57fc-4864-bb20-c66300b59ce4', '8d8fabf8-1388-4598-8baa-df81b23a6fe9', 'd1ea555c-89d3-47c3-89a2-f65dbfab79d6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:36:26 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] 3995c6d3-b961-4789-8642-3546544acbf3 was qcow2, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:26 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 Sep 28 21:36:26 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:26 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:36:26 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:26 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.467s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:36:26 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Deleted volume successfully. Sep 28 21:36:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ab7bf380-17f1-4db6-a1ea-dc509440542b tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-00adb8fa-8765-4f1d-935c-576f8df4c1b2-delete_volume" released by "delete_volume" :: held 8.046s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Flow 'volume_create_manager' (f3495c64-338f-46db-b787-bddef42e77f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d17c40-07f1-4e34-8de2-aaa7b4cbd796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d17c40-07f1-4e34-8de2-aaa7b4cbd796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-784839319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343cb6ba-8d91-4c24-8e1e-696f42b03d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8090d550e7450bb51194bc5ff070c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:28Z,use_quota=True,user_id='56823ae256fa40ee9646bb9cfb8224f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ec0ef4-a561-480d-8559-bdaf1545fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ec0ef4-a561-480d-8559-bdaf1545fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126c01c6-dc8a-45ad-b79d-91798f3e15f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126c01c6-dc8a-45ad-b79d-91798f3e15f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343cb6ba-8d91-4c24-8e1e-696f42b03d25', 'volume_name': 'volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ab510a-46cc-4794-8788-0981ea8d6fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ab510a-46cc-4794-8788-0981ea8d6fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c8667a-a71f-4a02-a878-967f90bfbbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Volume 343cb6ba-8d91-4c24-8e1e-696f42b03d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25', 'volume_size': 1} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-784839319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343cb6ba-8d91-4c24-8e1e-696f42b03d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8090d550e7450bb51194bc5ff070c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:28Z,use_quota=True,user_id='56823ae256fa40ee9646bb9cfb8224f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Creating volume 343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:36:27 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:36:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:28 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 1073741824 Sep 28 21:36:28 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:28 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8" returned: 0 in 2.359s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_yx_25sz5devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:36:28 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Converted 112.00 MB image at 47.37 MB/s Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:28 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 1G Sep 28 21:36:28 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:28 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 1073741824" returned: 0 in 0.669s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:28 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 Sep 28 21:36:28 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:28 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 1G" returned: 0 in 0.556s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Downloaded image 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume cac27c97-3ce7-4597-be04-757a927f2ce8 successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 for user d1a2ba56ac2f411e83be83f9f44f06ba is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:36:28 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Marking volume cac27c97-3ce7-4597-be04-757a927f2ce8 as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Copying metadata from image 3995c6d3-b961-4789-8642-3546544acbf3 to cac27c97-3ce7-4597-be04-757a927f2ce8. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Creating volume glance metadata for volume cac27c97-3ce7-4597-be04-757a927f2ce8 backed by image 3995c6d3-b961-4789-8642-3546544acbf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:36:29 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25" returned: 0 in 0.412s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c8667a-a71f-4a02-a878-967f90bfbbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad2aff3-fbf6-4d58-a094-0556c124c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e9c4d6-8acb-4de5-ba8e-d8b7c0712fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac27c97-3ce7-4597-be04-757a927f2ce8', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25063d8b-7553-482d-8dc0-0659e6bfe410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:29 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Volume volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 (343cb6ba-8d91-4c24-8e1e-696f42b03d25): created successfully Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad2aff3-fbf6-4d58-a094-0556c124c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Flow 'volume_create_manager' (f3495c64-338f-46db-b787-bddef42e77f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:29 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Volume volume-cac27c97-3ce7-4597-be04-757a927f2ce8 (cac27c97-3ce7-4597-be04-757a927f2ce8): created successfully Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25063d8b-7553-482d-8dc0-0659e6bfe410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Flow 'volume_create_manager' (9fb38fcd-a2f4-483e-bc3b-5d029fe7d154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a7d23034-97fe-4d0f-a2a9-57188526ac66 tempest-VolumesDeleteCascade-621532363 None] Created volume successfully. Sep 28 21:36:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-742a0a5b-426b-4f42-886f-ff1c0c8e1825 tempest-ServerActionsTestOtherA-493824196 None] Created volume successfully. Sep 28 21:36:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Creating offline snapshot bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 of volume 343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:36:30 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d2412d-d44a-4092-8821-69fe8b9fcc53]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:30 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 Sep 28 21:36:30 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:30 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25" returned: 0 in 0.441s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:30 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 1G Sep 28 21:36:30 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:31 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 1G" returned: 0 in 0.574s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:31 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 Sep 28 21:36:31 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:31 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" returned: 0 in 0.326s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:31 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 is being set with open permissions: ugo+rw Sep 28 21:36:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:31 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 Sep 28 21:36:31 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:32 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" returned: 0 in 0.317s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:32 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.info Sep 28 21:36:32 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:32 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.info" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:32 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.info is being set with open permissions: ugo+rw Sep 28 21:36:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:32 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.info Sep 28 21:36:32 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:32 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.info" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0cc8f8b3-ed45-4e8b-8c75-2e70ca0691bb tempest-VolumesDeleteCascade-621532363 None] Create snapshot completed successfully Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-f23e3622-aace-4b3c-9a76-6ca969156c60 req-45c54267-3fdd-4b29-9cbe-d1eeb49c1b5b tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-f23e3622-aace-4b3c-9a76-6ca969156c60 req-45c54267-3fdd-4b29-9cbe-d1eeb49c1b5b tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-f23e3622-aace-4b3c-9a76-6ca969156c60 req-45c54267-3fdd-4b29-9cbe-d1eeb49c1b5b tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-f23e3622-aace-4b3c-9a76-6ca969156c60 req-45c54267-3fdd-4b29-9cbe-d1eeb49c1b5b tempest-ServerActionsTestOtherA-493824196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-cac27c97-3ce7-4597-be04-757a927f2ce8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff31057a-334b-4571-9e0d-34d332a107fd', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Flow 'volume_create_manager' (a3c75ab2-05c5-4602-bd25-916497477002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e65a0d-4776-4177-97d6-deb984bc53d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e65a0d-4776-4177-97d6-deb984bc53d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1704765996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b649b0-b9b1-42ce-ba60-8a08cec1a8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8090d550e7450bb51194bc5ff070c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:34Z,use_quota=True,user_id='56823ae256fa40ee9646bb9cfb8224f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85adae69-b036-435e-80d4-c226e7af39c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85adae69-b036-435e-80d4-c226e7af39c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d268c91-bfd8-4715-a3be-fa98263fcddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d268c91-bfd8-4715-a3be-fa98263fcddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2b649b0-b9b1-42ce-ba60-8a08cec1a8df', 'volume_name': 'volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df', 'volume_size': 1, 'snapshot_id': 'bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42401c2c-b97f-44bf-ad69-3653ebc80173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42401c2c-b97f-44bf-ad69-3653ebc80173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d0f71b-6a99-4746-8a84-6cbce93121a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:34 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Volume d2b649b0-b9b1-42ce-ba60-8a08cec1a8df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df', 'volume_size': 1, 'snapshot_id': 'bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5'} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Creating volume d2b649b0-b9b1-42ce-ba60-8a08cec1a8df from snapshot bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-f23e3622-aace-4b3c-9a76-6ca969156c60 req-45c54267-3fdd-4b29-9cbe-d1eeb49c1b5b tempest-ServerActionsTestOtherA-493824196 None] attachment_update completed successfully. Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] snapshot: bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5, volume: d2b649b0-b9b1-42ce-ba60-8a08cec1a8df, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe52f6e-bd9d-4749-aa0c-a8abf5f04482]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:34 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 Sep 28 21:36:34 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:35 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" returned: 0 in 0.478s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83366d1-cb46-45b3-ab1d-22ecef57aebf]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:35 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 Sep 28 21:36:35 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:35 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25" returned: 0 in 0.432s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:36:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:35 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df Sep 28 21:36:35 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Flow 'volume_create_manager' (c6ab1444-a1cb-44bd-a0ae-118a41c4ee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ca9ddd-4d40-4c63-8bab-54129d440cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ca9ddd-4d40-4c63-8bab-54129d440cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1375193127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa681a2-277b-47f3-ab24-66f3663479bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daca1a2640cf48c999c94d95165405a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:43Z,use_quota=True,user_id='ebea70b95e4e4dc7b276560c08b7d767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4286c7b0-2c02-4e9a-a02e-e0f9d89e194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4286c7b0-2c02-4e9a-a02e-e0f9d89e194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c03dd99-a3f4-4a0e-b78c-c4e12111131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c03dd99-a3f4-4a0e-b78c-c4e12111131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa681a2-277b-47f3-ab24-66f3663479bc', 'volume_name': 'volume-efa681a2-277b-47f3-ab24-66f3663479bc', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed52128b-e065-4526-b517-ab4f7c6672c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed52128b-e065-4526-b517-ab4f7c6672c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c33e94-009e-4d4e-aa52-6fd4ae2d584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:43 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Volume efa681a2-277b-47f3-ab24-66f3663479bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa681a2-277b-47f3-ab24-66f3663479bc', 'volume_size': 1} Sep 28 21:36:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:47 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" returned: 0 in 11.845s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:47 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25, size 1024.00 MB, duration 11.85 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:36:47 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Converted 1024.00 MB image at 86.44 MB/s Sep 28 21:36:47 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df is being set with open permissions: ugo+rw Sep 28 21:36:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:47 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df Sep 28 21:36:47 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:48 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" returned: 0 in 0.764s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" released by "_copy_volume_from_snapshot" :: held 13.661s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" released by "_create_volume_from_snapshot" :: held 13.810s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.840s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.726s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1375193127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa681a2-277b-47f3-ab24-66f3663479bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daca1a2640cf48c999c94d95165405a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:36:43Z,use_quota=True,user_id='ebea70b95e4e4dc7b276560c08b7d767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Creating volume efa681a2-277b-47f3-ab24-66f3663479bc {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:36:48 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:48 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc 1073741824 Sep 28 21:36:48 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d0f71b-6a99-4746-8a84-6cbce93121a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df', 'volume_size': 1, 'snapshot_id': 'bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af062abb-980d-44ca-bd77-89de6f4fa6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Volume volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df (d2b649b0-b9b1-42ce-ba60-8a08cec1a8df): created successfully Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af062abb-980d-44ca-bd77-89de6f4fa6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Flow 'volume_create_manager' (a3c75ab2-05c5-4602-bd25-916497477002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-cb745f66-cdba-42de-a48f-cb7eee09eaf8 tempest-VolumesDeleteCascade-621532363 None] Created volume successfully. Sep 28 21:36:49 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc 1073741824" returned: 0 in 1.302s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:49 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc Sep 28 21:36:49 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-343cb6ba-8d91-4c24-8e1e-696f42b03d25-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-343cb6ba-8d91-4c24-8e1e-696f42b03d25-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Performing cascade delete. {{(pid=86489) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-343cb6ba-8d91-4c24-8e1e-696f42b03d25" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-343cb6ba-8d91-4c24-8e1e-696f42b03d25" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Deleting offline snapshot bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 of volume 343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] snapshot_file for this snap is: volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49642d6-2fb5-41fd-9a31-cb5bc1e31947]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:50 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc" returned: 0 in 0.644s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c33e94-009e-4d4e-aa52-6fd4ae2d584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa681a2-277b-47f3-ab24-66f3663479bc', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3237205-adef-497d-9cc2-64796eb90865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:36:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Volume volume-efa681a2-277b-47f3-ab24-66f3663479bc (efa681a2-277b-47f3-ab24-66f3663479bc): created successfully Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3237205-adef-497d-9cc2-64796eb90865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Flow 'volume_create_manager' (c6ab1444-a1cb-44bd-a0ae-118a41c4ee6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:36:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bf86feb6-af81-4ea3-85ca-db1a7a9ef72c tempest-AttachVolumeShelveTestJSON-1440110755 None] Created volume successfully. Sep 28 21:36:50 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 Sep 28 21:36:50 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:50 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" returned: 0 in 0.492s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba9adf1-fbec-4752-9737-8450a1d4fecb]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:51 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 Sep 28 21:36:51 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:52 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25" returned: 0 in 1.598s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:52 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 Sep 28 21:36:52 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:53 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" returned: 0 in 0.884s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:53 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5 Sep 28 21:36:53 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:54 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25.bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" returned: 0 in 0.624s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5" released by "_delete_snapshot" :: held 3.812s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-343cb6ba-8d91-4c24-8e1e-696f42b03d25" released by "delete_snapshot" :: held 3.865s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Created reservations ['8eeb8928-c849-43ce-8dbd-eb14d9b6c6f1', '5f1e50f6-b1d8-4986-9e23-fd7ce292e305', 'e045f17c-320f-404b-8c9c-d61053c3bb37', 'd3467659-bdef-4222-9b19-57bb86125d84'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:36:54 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Delete snapshot completed successfully. Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-bc04d5dc-cab4-4b21-ae4d-64aa72cd1af5-delete_snapshot" released by "delete_snapshot" :: held 4.302s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Snapshots deleted, issuing volume delete {{(pid=86489) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-343cb6ba-8d91-4c24-8e1e-696f42b03d25" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-343cb6ba-8d91-4c24-8e1e-696f42b03d25" acquired by "delete_volume" :: waited 0.039s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0606c3-3c0f-4d24-beb4-2d78bd932afa]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:54 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 Sep 28 21:36:54 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:55 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25" returned: 0 in 1.200s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:55 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25 Sep 28 21:36:55 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:56 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-343cb6ba-8d91-4c24-8e1e-696f42b03d25" returned: 0 in 0.619s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-343cb6ba-8d91-4c24-8e1e-696f42b03d25" released by "delete_volume" :: held 2.025s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:56 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Created reservations ['a36594e8-c2c6-44b8-82be-b941a51c5d34', '05741097-8e48-4e5c-b919-1fe9c1c0cb33', '5901f12d-cb46-4f85-babb-20206a5b2fe1', 'ecc77158-8312-48ec-ae92-14dc6a9b3f2c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:57 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:36:57 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:57 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.835s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:57 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:36:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Deleted volume successfully. Sep 28 21:36:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fb35789e-e88b-4862-bbfe-8bb7369d93f7 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-343cb6ba-8d91-4c24-8e1e-696f42b03d25-delete_volume" released by "delete_volume" :: held 8.054s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:36:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "cinder-quobyte-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:36:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" acquired by "delete_volume" :: waited 0.050s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:36:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e88225e-4604-4433-aba5-c5675d50d2e5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:36:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:58 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df Sep 28 21:36:58 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:59 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" returned: 0 in 0.759s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:36:59 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df Sep 28 21:36:59 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:36:59 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Sep 28 21:36:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" returned: 0 in 0.786s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:36:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-quobyte-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df" released by "delete_volume" :: held 1.719s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:00 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Created reservations ['064976a5-94e4-4bf3-bbab-fc83c29ce46f', '1e238aca-9a41-460c-aa7f-e49c40afa897', '7a7729c7-3435-4000-84ec-029d6741a9c5', '5454ac71-9c89-451e-a259-931ca6221d63'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:00 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:00 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:01 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.975s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:01 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Deleted volume successfully. Sep 28 21:37:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e71b2417-4509-4ed3-97ea-d0fea2ce4a92 tempest-VolumesDeleteCascade-621532363 None] Lock "cinder-d2b649b0-b9b1-42ce-ba60-8a08cec1a8df-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:03 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-4a6568af-940a-4ac0-9890-5f3b6ae67002 req-a87da053-ceed-4b03-a36f-94f4c369ebd4 tempest-ServerActionsTestOtherA-493824196 None] Terminate volume connection completed successfully. Sep 28 21:37:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-4a6568af-940a-4ac0-9890-5f3b6ae67002 req-a87da053-ceed-4b03-a36f-94f4c369ebd4 tempest-ServerActionsTestOtherA-493824196 None] Deleting attachment ff31057a-334b-4571-9e0d-34d332a107fd. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:37:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:37:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:07 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:07 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:07 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.517s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-4a6568af-940a-4ac0-9890-5f3b6ae67002 req-9f1b06be-e1a0-4149-a74f-530399a8ff68 tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-4a6568af-940a-4ac0-9890-5f3b6ae67002 req-9f1b06be-e1a0-4149-a74f-530399a8ff68 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-4a6568af-940a-4ac0-9890-5f3b6ae67002 req-9f1b06be-e1a0-4149-a74f-530399a8ff68 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-4a6568af-940a-4ac0-9890-5f3b6ae67002 req-9f1b06be-e1a0-4149-a74f-530399a8ff68 tempest-ServerActionsTestOtherA-493824196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-cac27c97-3ce7-4597-be04-757a927f2ce8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0105793b-0725-43ef-969c-5d2d40bf88e5', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:37:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-4a6568af-940a-4ac0-9890-5f3b6ae67002 req-9f1b06be-e1a0-4149-a74f-530399a8ff68 tempest-ServerActionsTestOtherA-493824196 None] attachment_update completed successfully. Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Flow 'volume_create_manager' (af0c3efd-f49d-48c1-97c7-664dabf33863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efcf4773-3bef-4e8b-ae39-a4a7ef2a6e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efcf4773-3bef-4e8b-ae39-a4a7ef2a6e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1973164777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665108d0-9173-4964-bb56-2d76978a0d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5937ce442a01433fa73b19637aa2a333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:13Z,use_quota=True,user_id='605a5863afa64302b15762b9fa11e4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfa0144-5e12-47b9-a749-b83be7040e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfa0144-5e12-47b9-a749-b83be7040e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9298014a-02c0-4640-8059-15917594c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9298014a-02c0-4640-8059-15917594c31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665108d0-9173-4964-bb56-2d76978a0d22', 'volume_name': 'volume-665108d0-9173-4964-bb56-2d76978a0d22', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b0bc6-0767-4745-bda9-153fa50a683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b0bc6-0767-4745-bda9-153fa50a683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c78a11-cea5-4d39-bb16-1213a1b5a381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:13 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Volume 665108d0-9173-4964-bb56-2d76978a0d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665108d0-9173-4964-bb56-2d76978a0d22', 'volume_size': 1} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1973164777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665108d0-9173-4964-bb56-2d76978a0d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5937ce442a01433fa73b19637aa2a333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:13Z,use_quota=True,user_id='605a5863afa64302b15762b9fa11e4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Creating volume 665108d0-9173-4964-bb56-2d76978a0d22 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:13 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:13 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 1073741824 Sep 28 21:37:13 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-bf7a4aa8-171d-4206-9ea3-003295a0e499 req-b7ee9678-17d3-4580-8f65-a0593dd9c082 tempest-AttachVolumeShelveTestJSON-1440110755 None] No connector for attachment 1ccbd64c-a45c-4417-b8af-203cf6b2a426; skipping storage backend terminate_connection call. {{(pid=86489) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 21:37:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-bf7a4aa8-171d-4206-9ea3-003295a0e499 req-b7ee9678-17d3-4580-8f65-a0593dd9c082 tempest-AttachVolumeShelveTestJSON-1440110755 None] Deleting attachment 1ccbd64c-a45c-4417-b8af-203cf6b2a426. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:37:15 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 1073741824" returned: 0 in 1.251s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:15 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 Sep 28 21:37:15 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:15 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22" returned: 0 in 0.792s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c78a11-cea5-4d39-bb16-1213a1b5a381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665108d0-9173-4964-bb56-2d76978a0d22', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d7bfab-9226-40eb-b37f-4808e60b81c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:16 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Volume volume-665108d0-9173-4964-bb56-2d76978a0d22 (665108d0-9173-4964-bb56-2d76978a0d22): created successfully Sep 28 21:37:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d7bfab-9226-40eb-b37f-4808e60b81c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Flow 'volume_create_manager' (af0c3efd-f49d-48c1-97c7-664dabf33863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3e5f20f4-8aa0-4a2e-a8c6-79a55344da5b tempest-VolumesTransfersV355Test-570090205 None] Created volume successfully. Sep 28 21:37:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-572ab023-3141-44d4-a6ab-fb09634ee538 tempest-VolumesTransfersV355Test-2059419879 None] Transfer volume completed successfully. Sep 28 21:37:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Acquiring lock "cinder-665108d0-9173-4964-bb56-2d76978a0d22-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Lock "cinder-665108d0-9173-4964-bb56-2d76978a0d22-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Acquiring lock "cinder-quobyte-665108d0-9173-4964-bb56-2d76978a0d22" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Lock "cinder-quobyte-665108d0-9173-4964-bb56-2d76978a0d22" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:20 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cd22f2-37cb-490d-9bd1-aecdcaec526c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:20 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 Sep 28 21:37:20 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:21 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22" returned: 0 in 0.883s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:21 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22 Sep 28 21:37:21 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:22 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-665108d0-9173-4964-bb56-2d76978a0d22" returned: 0 in 0.635s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Lock "cinder-quobyte-665108d0-9173-4964-bb56-2d76978a0d22" released by "delete_volume" :: held 1.624s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=65,cinder:INSERT=19,cinder:UPDATE=59,cinder:DELETE=6 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Flow 'volume_create_manager' (a36de3bf-c627-4ad7-8ef8-9d14bf5fe6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc735c4-de92-4a9b-a66e-5936c3d6d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc735c4-de92-4a9b-a66e-5936c3d6d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-88086459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61751ff-3d92-4608-b68a-f66680270be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57dc5af15ce45a29a7ba91fab957ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:22Z,use_quota=True,user_id='aa65d45d089744149b918fd6f812c713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4307d2c1-fe0d-45cf-ba7e-b4bf78a8f01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4307d2c1-fe0d-45cf-ba7e-b4bf78a8f01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312643de-5d06-4f13-9ca3-a21f55df5f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312643de-5d06-4f13-9ca3-a21f55df5f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61751ff-3d92-4608-b68a-f66680270be3', 'volume_name': 'volume-f61751ff-3d92-4608-b68a-f66680270be3', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee33303-eba1-43e2-bbfe-d484983f4874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee33303-eba1-43e2-bbfe-d484983f4874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bead5a63-bbf7-43b0-88e0-b078baf8ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Volume f61751ff-3d92-4608-b68a-f66680270be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61751ff-3d92-4608-b68a-f66680270be3', 'volume_size': 1} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-88086459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61751ff-3d92-4608-b68a-f66680270be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57dc5af15ce45a29a7ba91fab957ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:22Z,use_quota=True,user_id='aa65d45d089744149b918fd6f812c713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Creating volume f61751ff-3d92-4608-b68a-f66680270be3 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:22 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:22 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 1073741824 Sep 28 21:37:22 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Created reservations ['dea20f12-910f-4062-ac2e-dedfa159d280', '9d5ccbab-42f7-49ac-b41b-5ad58f8c3e91', 'ee5ea259-3b81-4f0d-912b-c97384f00155', 'd2eb1a19-789d-4f1d-9313-cfdac63d34a9'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:22 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:22 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:22 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.558s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:22 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:22 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Deleted volume successfully. Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3150cb4f-554c-4eec-9696-e8975a05d22c tempest-VolumesTransfersV355Test-165322037 None] Lock "cinder-665108d0-9173-4964-bb56-2d76978a0d22-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:23 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 1073741824" returned: 0 in 0.774s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:23 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 Sep 28 21:37:23 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:23 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3" returned: 0 in 0.657s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bead5a63-bbf7-43b0-88e0-b078baf8ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61751ff-3d92-4608-b68a-f66680270be3', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9384f6e8-5205-4374-bc93-5693a7729d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:23 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Volume volume-f61751ff-3d92-4608-b68a-f66680270be3 (f61751ff-3d92-4608-b68a-f66680270be3): created successfully Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9384f6e8-5205-4374-bc93-5693a7729d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Flow 'volume_create_manager' (a36de3bf-c627-4ad7-8ef8-9d14bf5fe6a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Flow 'volume_create_manager' (2083ce00-e82e-483e-9896-08c3e15bbfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f277cd7-fb7d-4b46-8316-073c740153ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0593934d-57f9-42e6-a258-9e41f4672d03 tempest-ServersNegativeTestJSON-878077059 None] Created volume successfully. Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f277cd7-fb7d-4b46-8316-073c740153ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-976840445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c31de3-f199-4400-a338-c093ac3d6685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5937ce442a01433fa73b19637aa2a333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:24Z,use_quota=True,user_id='605a5863afa64302b15762b9fa11e4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15102632-fa33-4d00-bb02-be7128d4ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15102632-fa33-4d00-bb02-be7128d4ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68417be7-8389-427f-9fef-41ed4d3e4bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68417be7-8389-427f-9fef-41ed4d3e4bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c31de3-f199-4400-a338-c093ac3d6685', 'volume_name': 'volume-86c31de3-f199-4400-a338-c093ac3d6685', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1046fd5-8a37-45a8-898c-8aacb179a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1046fd5-8a37-45a8-898c-8aacb179a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc8d209-0b2c-4407-9790-a44bd2a55e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:24 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Volume 86c31de3-f199-4400-a338-c093ac3d6685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c31de3-f199-4400-a338-c093ac3d6685', 'volume_size': 1} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-976840445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c31de3-f199-4400-a338-c093ac3d6685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5937ce442a01433fa73b19637aa2a333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:24Z,use_quota=True,user_id='605a5863afa64302b15762b9fa11e4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Creating volume 86c31de3-f199-4400-a338-c093ac3d6685 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:24 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:24 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 1073741824 Sep 28 21:37:24 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:24 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 1073741824" returned: 0 in 0.762s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:24 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 Sep 28 21:37:24 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:25 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685" returned: 0 in 0.360s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc8d209-0b2c-4407-9790-a44bd2a55e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c31de3-f199-4400-a338-c093ac3d6685', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6644a59-5481-4404-8617-8cd2bbf724b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Volume volume-86c31de3-f199-4400-a338-c093ac3d6685 (86c31de3-f199-4400-a338-c093ac3d6685): created successfully Sep 28 21:37:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6644a59-5481-4404-8617-8cd2bbf724b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Flow 'volume_create_manager' (2083ce00-e82e-483e-9896-08c3e15bbfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:25 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6a3b3f0e-b137-4467-b2a3-72b2428b46b8 tempest-VolumesTransfersV355Test-570090205 None] Created volume successfully. Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:INSERT=23,cinder:UPDATE=64,cinder:SELECT=70,cinder:DELETE=5 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Flow 'volume_create_manager' (22f19c19-017e-4902-af2e-2ce10c109a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92df173d-8e04-450d-a51d-0be5d5c09542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92df173d-8e04-450d-a51d-0be5d5c09542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-149041101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae68f417-09f6-4a37-be34-d05b84f5948b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57dc5af15ce45a29a7ba91fab957ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:26Z,use_quota=True,user_id='aa65d45d089744149b918fd6f812c713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1d9ace-b0d6-4042-9473-b6ba399170ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1d9ace-b0d6-4042-9473-b6ba399170ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b38e3cb-0d3b-4f4b-a66c-fea7241a17c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b38e3cb-0d3b-4f4b-a66c-fea7241a17c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae68f417-09f6-4a37-be34-d05b84f5948b', 'volume_name': 'volume-ae68f417-09f6-4a37-be34-d05b84f5948b', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfbec11-b091-42c6-b821-680f13dfeb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfbec11-b091-42c6-b821-680f13dfeb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98b02e9-1c5f-47c1-9d82-4630686b731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Volume ae68f417-09f6-4a37-be34-d05b84f5948b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae68f417-09f6-4a37-be34-d05b84f5948b', 'volume_size': 1} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-149041101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae68f417-09f6-4a37-be34-d05b84f5948b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57dc5af15ce45a29a7ba91fab957ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:26Z,use_quota=True,user_id='aa65d45d089744149b918fd6f812c713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Creating volume ae68f417-09f6-4a37-be34-d05b84f5948b {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:26 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:26 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b 1073741824 Sep 28 21:37:26 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Acquiring lock "cinder-86c31de3-f199-4400-a338-c093ac3d6685-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Lock "cinder-86c31de3-f199-4400-a338-c093ac3d6685-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Acquiring lock "cinder-quobyte-86c31de3-f199-4400-a338-c093ac3d6685" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Lock "cinder-quobyte-86c31de3-f199-4400-a338-c093ac3d6685" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe9c63-844f-4f09-9219-473766a3a913]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:26 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 Sep 28 21:37:26 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:26 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b 1073741824" returned: 0 in 0.562s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:26 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b Sep 28 21:37:26 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:27 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685" returned: 0 in 0.462s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:27 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685 Sep 28 21:37:27 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:27 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b" returned: 0 in 0.314s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98b02e9-1c5f-47c1-9d82-4630686b731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae68f417-09f6-4a37-be34-d05b84f5948b', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33792dae-7270-42f5-966f-a7ba67ca4e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Volume volume-ae68f417-09f6-4a37-be34-d05b84f5948b (ae68f417-09f6-4a37-be34-d05b84f5948b): created successfully Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33792dae-7270-42f5-966f-a7ba67ca4e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Flow 'volume_create_manager' (22f19c19-017e-4902-af2e-2ce10c109a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-57db61e3-fe56-46c4-954a-dd90cee5bc71 tempest-ServersNegativeTestJSON-878077059 None] Created volume successfully. Sep 28 21:37:27 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-86c31de3-f199-4400-a338-c093ac3d6685" returned: 0 in 0.299s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Lock "cinder-quobyte-86c31de3-f199-4400-a338-c093ac3d6685" released by "delete_volume" :: held 0.818s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Created reservations ['ddf98d88-3445-450a-8465-c219651a4e5c', 'e46ae62d-89d0-45d8-bc1d-196287e823fe', 'd132c61e-c8cb-49ff-b4db-b64d0c0bc3d1', 'c380dede-8c91-41ea-83ed-574407cc0765'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:27 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:27 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:27 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.277s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Deleted volume successfully. Sep 28 21:37:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c629f52d-5602-40d7-83cb-cf3122f7318b tempest-VolumesTransfersV355Test-165322037 None] Lock "cinder-86c31de3-f199-4400-a338-c093ac3d6685-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "cinder-ae68f417-09f6-4a37-be34-d05b84f5948b-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Lock "cinder-ae68f417-09f6-4a37-be34-d05b84f5948b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "cinder-quobyte-ae68f417-09f6-4a37-be34-d05b84f5948b" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Lock "cinder-quobyte-ae68f417-09f6-4a37-be34-d05b84f5948b" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:29 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[83300a31-d556-4026-a885-e3f25d979eb2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:29 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b Sep 28 21:37:29 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:29 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b" returned: 0 in 0.482s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:29 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b Sep 28 21:37:29 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:30 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ae68f417-09f6-4a37-be34-d05b84f5948b" returned: 0 in 0.559s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Lock "cinder-quobyte-ae68f417-09f6-4a37-be34-d05b84f5948b" released by "delete_volume" :: held 1.125s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Created reservations ['b0f5260b-2b0e-46f9-987f-fa4eb99dcf22', '92b88b7a-1332-4687-a7aa-1f48a6c9ce71', '5018eb03-7eac-4ca0-9ff2-c4fa72d9c87e', '475fc13f-9449-4071-a442-0d5e8992a07e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:30 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:30 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:30 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.343s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Deleted volume successfully. Sep 28 21:37:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8260d3a7-7ec9-4171-91ac-c1f99a09a713 tempest-ServersNegativeTestJSON-878077059 None] Lock "cinder-ae68f417-09f6-4a37-be34-d05b84f5948b-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "cinder-f61751ff-3d92-4608-b68a-f66680270be3-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Lock "cinder-f61751ff-3d92-4608-b68a-f66680270be3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "cinder-quobyte-f61751ff-3d92-4608-b68a-f66680270be3" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Lock "cinder-quobyte-f61751ff-3d92-4608-b68a-f66680270be3" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:31 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f5689-39b9-4dd9-8258-3980f5f7efba]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:31 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 Sep 28 21:37:31 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:31 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3" returned: 0 in 0.506s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:31 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3 Sep 28 21:37:31 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:32 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f61751ff-3d92-4608-b68a-f66680270be3" returned: 0 in 0.456s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Lock "cinder-quobyte-f61751ff-3d92-4608-b68a-f66680270be3" released by "delete_volume" :: held 1.050s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Created reservations ['b077c439-0a5c-4221-8c02-8a02b14bcb6e', '2b0fd86d-a9a3-4a90-8d87-6c2f92562762', 'cce34bbc-304c-4f4f-8b1e-9e94b9753ee0', 'eb1f8517-b49f-4907-8cd5-e6afc06d4b9f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:32 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:32 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:32 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.368s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:32 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Deleted volume successfully. Sep 28 21:37:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8d2590e-9300-4609-aa1e-2560824edfda tempest-ServersNegativeTestJSON-878077059 None] Lock "cinder-f61751ff-3d92-4608-b68a-f66680270be3-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Flow 'volume_create_manager' (4394bde2-ae46-4744-8fe4-51148f2af71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901367c9-904e-4434-87b4-8f62d5cbc9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901367c9-904e-4434-87b4-8f62d5cbc9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-605338999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff123c4-d2e8-40de-9241-492a2c56774a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30790c01e0eb4f1b96dcb350a228b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:39Z,use_quota=True,user_id='67b7ca67447540a5b25f25cc846bd97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b16463-8df8-4899-a6ca-068593a8a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b16463-8df8-4899-a6ca-068593a8a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b356c8a1-3c32-444f-bb43-9eceb2da6afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b356c8a1-3c32-444f-bb43-9eceb2da6afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ff123c4-d2e8-40de-9241-492a2c56774a', 'volume_name': 'volume-4ff123c4-d2e8-40de-9241-492a2c56774a', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3752049a-90aa-4958-bcf5-52f5c74b5a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3752049a-90aa-4958-bcf5-52f5c74b5a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95056de-329b-49a9-b3ea-1ae4a2e24aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:39 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Volume 4ff123c4-d2e8-40de-9241-492a2c56774a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ff123c4-d2e8-40de-9241-492a2c56774a', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 21:37:39 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Trying to clone 4ff123c4-d2e8-40de-9241-492a2c56774a from image 3995c6d3-b961-4789-8642-3546544acbf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:37:40 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:37:40 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Image download 20.69 MB at 20.69 MB/s Sep 28 21:37:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[00560b73-c0f3-49a9-9582-2a54f8cf2938]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:40 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD Sep 28 21:37:40 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:40 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:40 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 is fetched for user 67b7ca67447540a5b25f25cc846bd97a. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:37:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c4362d-f622-4227-beff-8782a3481c04]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:40 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD Sep 28 21:37:40 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:41 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-605338999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff123c4-d2e8-40de-9241-492a2c56774a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30790c01e0eb4f1b96dcb350a228b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:39Z,use_quota=True,user_id='67b7ca67447540a5b25f25cc846bd97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Creating volume 4ff123c4-d2e8-40de-9241-492a2c56774a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:41 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:41 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a 1073741824 Sep 28 21:37:41 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:41 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a 1073741824" returned: 0 in 0.617s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:41 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a Sep 28 21:37:41 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:42 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a" returned: 0 in 0.417s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:42 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Attempting download of 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume 4ff123c4-d2e8-40de-9241-492a2c56774a. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:37:42 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4e57a3-895c-4348-8ed7-f345968ec39b]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_m6um37bb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:42 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_m6um37bb Sep 28 21:37:42 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:42 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_m6um37bb" returned: 0 in 0.492s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_m6um37bb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:43 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_m6um37bb Sep 28 21:37:43 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:43 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_m6um37bb" returned: 1 in 0.439s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_m6um37bb' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:37:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c29606-3d43-443b-ad60-dc115172f018]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:43 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD Sep 28 21:37:43 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:43 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:43 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] 3995c6d3-b961-4789-8642-3546544acbf3 was qcow2, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:37:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:43 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a Sep 28 21:37:43 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:46 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a" returned: 0 in 2.392s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3qns8poodevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:37:46 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Converted 112.00 MB image at 46.79 MB/s Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:46 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a 1G Sep 28 21:37:46 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Flow 'volume_create_manager' (50890093-3653-4afc-a977-38220c976261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bd070a-0f18-4b13-8e7d-ad39f14646c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bd070a-0f18-4b13-8e7d-ad39f14646c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1562127923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08db0726-1158-4c3c-aac5-0cf6b7570aaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1210e43c1c4b466482c866a6d5d5528d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:46Z,use_quota=True,user_id='8478413227e44d0a960f50796d576b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248d71ce-2704-4cf5-8abd-dcd48435459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248d71ce-2704-4cf5-8abd-dcd48435459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4f6405-6060-4f84-8da8-0ed1df709945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4f6405-6060-4f84-8da8-0ed1df709945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08db0726-1158-4c3c-aac5-0cf6b7570aaa', 'volume_name': 'volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f75aee2-f555-4d9f-8c3b-cc88949cab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f75aee2-f555-4d9f-8c3b-cc88949cab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae16d471-765d-49c2-b096-3cff5b73eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:46 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Volume 08db0726-1158-4c3c-aac5-0cf6b7570aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa', 'volume_size': 1} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1562127923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08db0726-1158-4c3c-aac5-0cf6b7570aaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1210e43c1c4b466482c866a6d5d5528d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:46Z,use_quota=True,user_id='8478413227e44d0a960f50796d576b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Creating volume 08db0726-1158-4c3c-aac5-0cf6b7570aaa {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:46 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:46 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa 1073741824 Sep 28 21:37:46 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:46 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a 1G" returned: 0 in 0.372s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Downloaded image 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume 4ff123c4-d2e8-40de-9241-492a2c56774a successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 for user 67b7ca67447540a5b25f25cc846bd97a is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Marking volume 4ff123c4-d2e8-40de-9241-492a2c56774a as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Copying metadata from image 3995c6d3-b961-4789-8642-3546544acbf3 to 4ff123c4-d2e8-40de-9241-492a2c56774a. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Creating volume glance metadata for volume 4ff123c4-d2e8-40de-9241-492a2c56774a backed by image 3995c6d3-b961-4789-8642-3546544acbf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95056de-329b-49a9-b3ea-1ae4a2e24aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff123c4-d2e8-40de-9241-492a2c56774a', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146acdbf-becf-4535-b6fc-e0ca98cd7d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:46 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Volume volume-4ff123c4-d2e8-40de-9241-492a2c56774a (4ff123c4-d2e8-40de-9241-492a2c56774a): created successfully Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146acdbf-becf-4535-b6fc-e0ca98cd7d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Flow 'volume_create_manager' (4394bde2-ae46-4744-8fe4-51148f2af71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c5e6d236-469b-49c6-9595-cb6ef11073db tempest-VolumesExtendTest-1625274199 None] Created volume successfully. Sep 28 21:37:46 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa 1073741824" returned: 0 in 0.501s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:46 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa Sep 28 21:37:46 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0183e1b3-e68f-42a4-9ba4-462538a8a3fa tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:47 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa" returned: 0 in 0.514s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0183e1b3-e68f-42a4-9ba4-462538a8a3fa tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.070s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae16d471-765d-49c2-b096-3cff5b73eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d6f5a8-ba31-44bd-8108-f9b339ab9a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbbe533-48b9-443d-a539-3a14583db633]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0183e1b3-e68f-42a4-9ba4-462538a8a3fa tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:47 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Volume volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa (08db0726-1158-4c3c-aac5-0cf6b7570aaa): created successfully Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d6f5a8-ba31-44bd-8108-f9b339ab9a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Flow 'volume_create_manager' (50890093-3653-4afc-a977-38220c976261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6bb06c48-937b-4bd4-a6fb-e0eff38310d7 tempest-VolumesTestJSON-1344297692 None] Created volume successfully. Sep 28 21:37:47 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a Sep 28 21:37:47 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:47 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0183e1b3-e68f-42a4-9ba4-462538a8a3fa tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a" returned: 0 in 0.420s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0183e1b3-e68f-42a4-9ba4-462538a8a3fa tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a 2G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0183e1b3-e68f-42a4-9ba4-462538a8a3fa tempest-VolumesExtendTest-1625274199 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a 2G" returned: 0 in 0.132s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0183e1b3-e68f-42a4-9ba4-462538a8a3fa tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.599s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0183e1b3-e68f-42a4-9ba4-462538a8a3fa tempest-VolumesExtendTest-1625274199 None] Extend volume completed successfully. Sep 28 21:37:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-c305ee78-3833-485e-8010-310a96f543af req-dc0b3fb3-d922-4bd2-88f5-f3ef1ea80a6c tempest-ServerActionsTestOtherA-493824196 None] Terminate volume connection completed successfully. Sep 28 21:37:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-c305ee78-3833-485e-8010-310a96f543af req-dc0b3fb3-d922-4bd2-88f5-f3ef1ea80a6c tempest-ServerActionsTestOtherA-493824196 None] Deleting attachment 0105793b-0725-43ef-969c-5d2d40bf88e5. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:37:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "cinder-cac27c97-3ce7-4597-be04-757a927f2ce8-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "cinder-4ff123c4-d2e8-40de-9241-492a2c56774a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Lock "cinder-4ff123c4-d2e8-40de-9241-492a2c56774a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Lock "cinder-cac27c97-3ce7-4597-be04-757a927f2ce8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "cinder-quobyte-4ff123c4-d2e8-40de-9241-492a2c56774a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "cinder-quobyte-cac27c97-3ce7-4597-be04-757a927f2ce8" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Lock "cinder-quobyte-cac27c97-3ce7-4597-be04-757a927f2ce8" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Lock "cinder-quobyte-4ff123c4-d2e8-40de-9241-492a2c56774a" acquired by "delete_volume" :: waited 0.050s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bfb10d-8e19-41c6-8f98-4ad4a875dea7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Flow 'volume_create_manager' (bd581266-72ae-4a2e-ba30-ab31958c68af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd408d0-69bf-48c9-9e2c-195f52cd75c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be18eb6-1856-4094-97a2-b5c97db28016]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd408d0-69bf-48c9-9e2c-195f52cd75c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-400821045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d681471e-c7bd-46b6-bddc-02828d293a97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1210e43c1c4b466482c866a6d5d5528d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:49Z,use_quota=True,user_id='8478413227e44d0a960f50796d576b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bd7121-6892-4d0f-93e4-7d3e45161332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bd7121-6892-4d0f-93e4-7d3e45161332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a9231a-209c-4711-9e26-4cb1b70e441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a9231a-209c-4711-9e26-4cb1b70e441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd681471e-c7bd-46b6-bddc-02828d293a97', 'volume_name': 'volume-d681471e-c7bd-46b6-bddc-02828d293a97', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6635a9c9-dc96-452d-89b2-966b52524a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6635a9c9-dc96-452d-89b2-966b52524a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdb679d-7da7-4233-9c4c-c9807bb0145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:49 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Volume d681471e-c7bd-46b6-bddc-02828d293a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d681471e-c7bd-46b6-bddc-02828d293a97', 'volume_size': 1} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-400821045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d681471e-c7bd-46b6-bddc-02828d293a97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1210e43c1c4b466482c866a6d5d5528d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:49Z,use_quota=True,user_id='8478413227e44d0a960f50796d576b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Creating volume d681471e-c7bd-46b6-bddc-02828d293a97 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:49 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 Sep 28 21:37:49 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:49 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:49 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 1073741824 Sep 28 21:37:49 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:49 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a Sep 28 21:37:49 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:49 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8" returned: 0 in 0.434s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:49 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8 Sep 28 21:37:49 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:49 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a" returned: 0 in 0.433s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:49 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a Sep 28 21:37:49 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:49 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 1073741824" returned: 0 in 0.516s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:49 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:49 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cac27c97-3ce7-4597-be04-757a927f2ce8" returned: 0 in 0.281s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:49 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Lock "cinder-quobyte-cac27c97-3ce7-4597-be04-757a927f2ce8" released by "delete_volume" :: held 0.774s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:50 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4ff123c4-d2e8-40de-9241-492a2c56774a" returned: 0 in 0.308s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Lock "cinder-quobyte-4ff123c4-d2e8-40de-9241-492a2c56774a" released by "delete_volume" :: held 0.823s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.quota [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Created reservations ['b132d2d1-7106-4484-9d53-12346d75d96c', 'bb173484-a391-48ff-b90e-553295796c00', 'c13abe92-f012-421d-a4d4-cb1cf9155227', 'cc8d1414-1282-4ae4-944b-e35340ad38ec'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:50 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:50 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Created reservations ['cbdc75f1-a240-4b99-b0fa-c81a6f812d3e', '1b833b21-f1ef-4244-95fe-6d58d696e034', '27e8ec54-bbcc-4e62-9778-45718f777451', 'd778262d-2daa-4de6-b1d4-97427c7ddd3c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:50 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97" returned: 0 in 0.303s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdb679d-7da7-4233-9c4c-c9807bb0145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d681471e-c7bd-46b6-bddc-02828d293a97', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a9548b-e6c2-409d-a0b6-a3b570ae9109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Volume volume-d681471e-c7bd-46b6-bddc-02828d293a97 (d681471e-c7bd-46b6-bddc-02828d293a97): created successfully Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a9548b-e6c2-409d-a0b6-a3b570ae9109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Flow 'volume_create_manager' (bd581266-72ae-4a2e-ba30-ab31958c68af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:50 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:50 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-31947702-cf7a-471d-95d8-7fb2a31eb4d7 tempest-VolumesTestJSON-1344297692 None] Created volume successfully. Sep 28 21:37:50 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.298s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.manager [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Deleted volume successfully. Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-c305ee78-3833-485e-8010-310a96f543af req-33c36506-345d-46d0-a8a0-1ee6165f2bcf tempest-ServerActionsTestOtherA-493824196 None] Lock "cinder-cac27c97-3ce7-4597-be04-757a927f2ce8-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "cinder-55d22d7a-6a04-4b8e-b6e1-e71a14388d76-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Lock "cinder-55d22d7a-6a04-4b8e-b6e1-e71a14388d76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "cinder-quobyte-55d22d7a-6a04-4b8e-b6e1-e71a14388d76" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:50 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.266s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Deleted volume successfully. Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Lock "cinder-quobyte-55d22d7a-6a04-4b8e-b6e1-e71a14388d76" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fccab56d-8aaf-4ac4-98e2-a4b66d6536e2 tempest-VolumesExtendTest-1625274199 None] Lock "cinder-4ff123c4-d2e8-40de-9241-492a2c56774a-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[090e95ef-ee67-45f4-a6f1-06a2e3876329]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:50 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 Sep 28 21:37:50 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:50 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76" returned: 0 in 0.369s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:50 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76 Sep 28 21:37:50 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:51 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55d22d7a-6a04-4b8e-b6e1-e71a14388d76" returned: 0 in 0.263s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Lock "cinder-quobyte-55d22d7a-6a04-4b8e-b6e1-e71a14388d76" released by "delete_volume" :: held 0.681s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Created reservations ['427afedf-b619-428b-b692-9f59fc34f5c7', '517e1bc0-22e0-48f1-ab09-f4085ec26938', 'fae234d4-62ca-4c3e-8417-360c309c63ea', 'bf57bd46-001e-4fdf-990d-8fff10278481'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:51 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:51 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:51 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.310s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Deleted volume successfully. Sep 28 21:37:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5dd6fa08-97c3-47f5-b189-c83ae55363c9 tempest-ServerActionsTestOtherA-493824196 None] Lock "cinder-55d22d7a-6a04-4b8e-b6e1-e71a14388d76-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Flow 'volume_create_manager' (5b570a7e-0c69-49fb-bcb2-15e67aab4e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeaebc0e-cd4d-4894-9c9c-f96bff17eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeaebc0e-cd4d-4894-9c9c-f96bff17eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1718561677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7293449f-6e15-4344-b5cb-36e0adf6a9e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1210e43c1c4b466482c866a6d5d5528d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:52Z,use_quota=True,user_id='8478413227e44d0a960f50796d576b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436dbf98-d574-455e-9c1a-f6a56fad7847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436dbf98-d574-455e-9c1a-f6a56fad7847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f764bdf-9993-4115-afd5-6974f9c8c2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f764bdf-9993-4115-afd5-6974f9c8c2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7293449f-6e15-4344-b5cb-36e0adf6a9e8', 'volume_name': 'volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a303587-3124-499b-8d2e-13493525d248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a303587-3124-499b-8d2e-13493525d248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1967ce-1b29-4280-9bb9-d471f36030e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Volume 7293449f-6e15-4344-b5cb-36e0adf6a9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8', 'volume_size': 1} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1718561677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7293449f-6e15-4344-b5cb-36e0adf6a9e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1210e43c1c4b466482c866a6d5d5528d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:52Z,use_quota=True,user_id='8478413227e44d0a960f50796d576b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Creating volume 7293449f-6e15-4344-b5cb-36e0adf6a9e8 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:52 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:37:52 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 1073741824 Sep 28 21:37:52 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Flow 'volume_create_manager' (0ba5b85e-549b-43e6-96f6-fb215c2b9b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd1e83f-08c1-4f43-8962-b585dc52ecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd1e83f-08c1-4f43-8962-b585dc52ecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-518919762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0723f0ba-5f67-404f-8326-310ed2677747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30790c01e0eb4f1b96dcb350a228b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:52Z,use_quota=True,user_id='67b7ca67447540a5b25f25cc846bd97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d85e25-e422-4d38-811e-8db753f5ca1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d85e25-e422-4d38-811e-8db753f5ca1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebc8ca2-d628-4b23-951a-184432e88e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebc8ca2-d628-4b23-951a-184432e88e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0723f0ba-5f67-404f-8326-310ed2677747', 'volume_name': 'volume-0723f0ba-5f67-404f-8326-310ed2677747', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0e5816-00a8-4395-923c-5c7788d74858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0e5816-00a8-4395-923c-5c7788d74858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64d6963-2d1a-42ba-ab67-6f91aedbd707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Volume 0723f0ba-5f67-404f-8326-310ed2677747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0723f0ba-5f67-404f-8326-310ed2677747', 'volume_size': 1} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:52 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 1073741824" returned: 0 in 0.671s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:52 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 Sep 28 21:37:52 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:53 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8" returned: 0 in 0.290s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-518919762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0723f0ba-5f67-404f-8326-310ed2677747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30790c01e0eb4f1b96dcb350a228b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:37:52Z,use_quota=True,user_id='67b7ca67447540a5b25f25cc846bd97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Creating volume 0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:37:53 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1967ce-1b29-4280-9bb9-d471f36030e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d5cf1a-070e-4aa8-9e86-350ca6d07266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:53 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 1073741824 Sep 28 21:37:53 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:53 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Volume volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 (7293449f-6e15-4344-b5cb-36e0adf6a9e8): created successfully Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d5cf1a-070e-4aa8-9e86-350ca6d07266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Flow 'volume_create_manager' (5b570a7e-0c69-49fb-bcb2-15e67aab4e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:53 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-174cc717-9a21-422e-a789-310c68ba90fe tempest-VolumesTestJSON-1344297692 None] Created volume successfully. Sep 28 21:37:54 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 1073741824" returned: 0 in 0.960s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:54 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 Sep 28 21:37:54 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:54 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747" returned: 0 in 0.330s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64d6963-2d1a-42ba-ab67-6f91aedbd707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0723f0ba-5f67-404f-8326-310ed2677747', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad19c017-8a85-44a6-90b0-62d54beb5c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:37:54 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Volume volume-0723f0ba-5f67-404f-8326-310ed2677747 (0723f0ba-5f67-404f-8326-310ed2677747): created successfully Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad19c017-8a85-44a6-90b0-62d54beb5c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:37:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Flow 'volume_create_manager' (0ba5b85e-549b-43e6-96f6-fb215c2b9b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:37:54 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3c386375-9dd3-41bf-8c1b-9e6f7c3870e7 tempest-VolumesExtendTest-1625274199 None] Created volume successfully. Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "cinder-7293449f-6e15-4344-b5cb-36e0adf6a9e8-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-7293449f-6e15-4344-b5cb-36e0adf6a9e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "cinder-quobyte-7293449f-6e15-4344-b5cb-36e0adf6a9e8" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-quobyte-7293449f-6e15-4344-b5cb-36e0adf6a9e8" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3ff35-a8dd-4f2a-afbe-0c62ce794dd4]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:55 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 Sep 28 21:37:55 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Creating offline snapshot 8736264c-3653-4835-a329-e177b60e26e2 of volume 0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca9ef0e-e84f-45e5-9d6e-cb3192c47e1d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:55 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 Sep 28 21:37:55 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:55 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8" returned: 0 in 0.439s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:55 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8 Sep 28 21:37:55 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:55 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7293449f-6e15-4344-b5cb-36e0adf6a9e8" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:55 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747" returned: 0 in 0.540s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-quobyte-7293449f-6e15-4344-b5cb-36e0adf6a9e8" released by "delete_volume" :: held 0.863s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:56 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 1G Sep 28 21:37:56 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Created reservations ['65b577d2-0d5c-464b-a225-a4ed843270aa', '2ac038e2-2fef-41a0-9c21-51e3b24ab858', '882ca1c5-7c9e-4d96-ac28-462499d32d47', '2387fd1e-876d-4aa0-9615-ee189320a568'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:56 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:56 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "cinder-d681471e-c7bd-46b6-bddc-02828d293a97-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-d681471e-c7bd-46b6-bddc-02828d293a97-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "cinder-quobyte-d681471e-c7bd-46b6-bddc-02828d293a97" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-quobyte-d681471e-c7bd-46b6-bddc-02828d293a97" acquired by "delete_volume" :: waited 0.042s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abef86c-e3eb-4038-9073-88bebd2364c4]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:56 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.437s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Deleted volume successfully. Sep 28 21:37:56 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 1G" returned: 0 in 0.736s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0723f0ba-5f67-404f-8326-310ed2677747 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:56 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 Sep 28 21:37:56 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-826f1d4f-8cf3-4f7f-a0dd-77b5f0c5f310 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-7293449f-6e15-4344-b5cb-36e0adf6a9e8-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:56 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0723f0ba-5f67-404f-8326-310ed2677747 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 Sep 28 21:37:56 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:57 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97" returned: 0 in 0.666s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:57 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97 Sep 28 21:37:57 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:57 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0723f0ba-5f67-404f-8326-310ed2677747 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2" returned: 0 in 0.574s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:57 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 is being set with open permissions: ugo+rw Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:57 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 Sep 28 21:37:57 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:57 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d681471e-c7bd-46b6-bddc-02828d293a97" returned: 0 in 0.380s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-quobyte-d681471e-c7bd-46b6-bddc-02828d293a97" released by "delete_volume" :: held 1.125s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Created reservations ['a8e59036-c6a0-4ae5-8dcb-ef7440dc0d23', '5ff55f9b-e681-4e8f-b24e-ae01786e9c8d', '4c328860-3c00-434e-af4e-de5fc7f82ba4', '246106d8-e162-456c-8078-67d06b10a8f9'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:57 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2" returned: 0 in 0.399s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:57 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.info Sep 28 21:37:57 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:57 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:57 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:58 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.info" returned: 0 in 0.370s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:58 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.info is being set with open permissions: ugo+rw Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:58 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:58 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.info Sep 28 21:37:58 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.335s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:37:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Deleted volume successfully. Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eeed7c1c-3e04-4d9a-9836-0faba93cd915 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-d681471e-c7bd-46b6-bddc-02828d293a97-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:58 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.info" returned: 0 in 0.302s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e0ca8ff7-6a51-44cb-8664-c748151a859f tempest-VolumesExtendTest-1625274199 None] Create snapshot completed successfully Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "cinder-08db0726-1158-4c3c-aac5-0cf6b7570aaa-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-08db0726-1158-4c3c-aac5-0cf6b7570aaa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "cinder-quobyte-08db0726-1158-4c3c-aac5-0cf6b7570aaa" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-quobyte-08db0726-1158-4c3c-aac5-0cf6b7570aaa" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-524de9d5-a374-46bb-8fa7-ef56b5608893 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-524de9d5-a374-46bb-8fa7-ef56b5608893 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e136929f-dbf2-4584-954c-212f67392e3b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524de9d5-a374-46bb-8fa7-ef56b5608893 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f01f2-bc6b-4676-ba12-e2e489901133]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:37:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:59 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 Sep 28 21:37:59 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:59 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa Sep 28 21:37:59 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:59 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524de9d5-a374-46bb-8fa7-ef56b5608893 tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747" returned: 0 in 0.471s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:59 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524de9d5-a374-46bb-8fa7-ef56b5608893 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 2G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa" returned: 0 in 0.490s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:59 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa Sep 28 21:37:59 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524de9d5-a374-46bb-8fa7-ef56b5608893 tempest-VolumesExtendTest-1625274199 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 2G" returned: 0 in 0.184s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-524de9d5-a374-46bb-8fa7-ef56b5608893 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.714s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:59 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-524de9d5-a374-46bb-8fa7-ef56b5608893 tempest-VolumesExtendTest-1625274199 None] Extend volume completed successfully. Sep 28 21:37:59 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-08db0726-1158-4c3c-aac5-0cf6b7570aaa" returned: 0 in 0.290s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-quobyte-08db0726-1158-4c3c-aac5-0cf6b7570aaa" released by "delete_volume" :: held 0.908s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Created reservations ['eee45448-d99d-4689-8816-7e963eb15036', 'c23a4bd2-5ea9-409a-b78d-c1a24814eec1', '43855a9c-6444-4479-b83a-be4e5ce7e471', '8e5f6989-8e20-4c08-bb1e-821dede575ca'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:37:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:37:59 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:37:59 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Acquiring lock "cinder-8736264c-3653-4835-a329-e177b60e26e2-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Lock "cinder-8736264c-3653-4835-a329-e177b60e26e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Acquiring lock "cinder-quobyte-0723f0ba-5f67-404f-8326-310ed2677747" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Lock "cinder-quobyte-0723f0ba-5f67-404f-8326-310ed2677747" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Acquiring lock "cinder-quobyte-8736264c-3653-4835-a329-e177b60e26e2" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Lock "cinder-quobyte-8736264c-3653-4835-a329-e177b60e26e2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:00 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Deleting offline snapshot 8736264c-3653-4835-a329-e177b60e26e2 of volume 0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] snapshot_file for this snap is: volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.394s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:38:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Deleted volume successfully. Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72483ec-5af3-426c-9662-4dbb56998249]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a1e67a73-4a86-41c5-8f95-863d4bdb2ca0 tempest-VolumesTestJSON-1344297692 None] Lock "cinder-08db0726-1158-4c3c-aac5-0cf6b7570aaa-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:00 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 Sep 28 21:38:00 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:00 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2" returned: 0 in 0.430s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0723f0ba-5f67-404f-8326-310ed2677747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca1aaea-fb76-445f-bdce-c85ae152f244]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:01 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 Sep 28 21:38:01 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Acquiring lock "cinder-efa681a2-277b-47f3-ab24-66f3663479bc-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:01 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747" returned: 0 in 0.574s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "cinder-efa681a2-277b-47f3-ab24-66f3663479bc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:01 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 Sep 28 21:38:01 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Acquiring lock "cinder-quobyte-efa681a2-277b-47f3-ab24-66f3663479bc" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "cinder-quobyte-efa681a2-277b-47f3-ab24-66f3663479bc" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee5941d-d9ef-4a51-afae-aa0ca5c27ca9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:01 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc Sep 28 21:38:01 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:01 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2" returned: 0 in 0.526s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:01 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2 Sep 28 21:38:01 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:02 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc" returned: 0 in 0.569s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:02 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc Sep 28 21:38:02 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:02 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747.8736264c-3653-4835-a329-e177b60e26e2" returned: 0 in 0.385s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Lock "cinder-quobyte-8736264c-3653-4835-a329-e177b60e26e2" released by "_delete_snapshot" :: held 2.113s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Lock "cinder-quobyte-0723f0ba-5f67-404f-8326-310ed2677747" released by "delete_snapshot" :: held 2.143s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Created reservations ['a0954f0e-6c2f-400d-b1d7-d26ab38dd372', '507f4a88-5a7e-4e9d-ad6a-139d1678610f', 'b10f9797-6c48-447a-b8a5-d32ac14561d6', '30961ddd-0e56-4bf2-bac5-ab15d6d53f92'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:38:02 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efa681a2-277b-47f3-ab24-66f3663479bc" returned: 0 in 0.431s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "cinder-quobyte-efa681a2-277b-47f3-ab24-66f3663479bc" released by "delete_volume" :: held 1.080s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:02 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Delete snapshot completed successfully. Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-53f8b7e1-b9fb-48fb-9b64-16894bc3ed4d tempest-VolumesExtendTest-1625274199 None] Lock "cinder-8736264c-3653-4835-a329-e177b60e26e2-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Created reservations ['5932c745-02d0-42eb-9909-5659eb03c60e', '90127e59-df18-4883-bf20-6b1d78569eec', 'ca98ca11-5840-454a-8640-d168845cb2ec', '616e59cf-1490-42f8-81df-558fc35b987c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:02 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:38:02 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:02 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.263s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:02 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:38:02 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Deleted volume successfully. Sep 28 21:38:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a5fff22-db22-42b2-b405-774363476cb8 tempest-AttachVolumeShelveTestJSON-1440110755 None] Lock "cinder-efa681a2-277b-47f3-ab24-66f3663479bc-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "cinder-0723f0ba-5f67-404f-8326-310ed2677747-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Lock "cinder-0723f0ba-5f67-404f-8326-310ed2677747-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "cinder-quobyte-0723f0ba-5f67-404f-8326-310ed2677747" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Lock "cinder-quobyte-0723f0ba-5f67-404f-8326-310ed2677747" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:03 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e16082-e11f-4ab1-aa1c-e8d5c36986f6]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:03 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 Sep 28 21:38:03 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:04 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747" returned: 0 in 0.442s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:04 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747 Sep 28 21:38:04 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:04 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0723f0ba-5f67-404f-8326-310ed2677747" returned: 0 in 0.299s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Lock "cinder-quobyte-0723f0ba-5f67-404f-8326-310ed2677747" released by "delete_volume" :: held 0.840s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Created reservations ['97ebdc2d-7e67-4ff8-bfa4-84b485391af9', 'fefd9b44-5bc4-49aa-b957-fb1d9df7a7f3', '52fc4b44-c00d-4b56-ab23-61dfe36b86bf', '3ffa45a9-eb95-4453-aa8d-42259e1662f6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:04 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:38:04 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:05 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.326s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:05 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:38:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Deleted volume successfully. Sep 28 21:38:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-280f7bea-793e-45e7-b9ad-0e0ceafe74e6 tempest-VolumesExtendTest-1625274199 None] Lock "cinder-0723f0ba-5f67-404f-8326-310ed2677747-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-89310d79-4795-4759-aafa-20b3c6510c1f tempest-GroupsV320Test-557880691 None] Group tempest-GroupsV320Test-Group-1246073675: creating Sep 28 21:38:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-89310d79-4795-4759-aafa-20b3c6510c1f tempest-GroupsV320Test-557880691 None] Group tempest-GroupsV320Test-Group-1246073675: created successfully Sep 28 21:38:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-89310d79-4795-4759-aafa-20b3c6510c1f tempest-GroupsV320Test-557880691 None] Create group completed successfully. Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:07 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:38:07 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:07 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.310s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 28 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:38:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Created reservations ['014e1375-61d1-4e6b-9f7a-319238dae286'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:08 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:38:08 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:08 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.301s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:38:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0808f651-b809-4473-a3e5-6cdd279ceaf9 tempest-GroupsV320Test-557880691 None] Delete group completed successfully. Sep 28 21:38:18 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:INSERT=34,cinder:UPDATE=132,cinder:SELECT=91,cinder:DELETE=12 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:38:18 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=126,cinder:SELECT=100,cinder:INSERT=37,cinder:DELETE=7 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Flow 'volume_create_manager' (441abd9f-7dc7-4b5a-9ff8-2350de286ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58602cb-87b9-4612-80c1-21ea47d8a053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58602cb-87b9-4612-80c1-21ea47d8a053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-594190668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1e918f-5c8e-40e2-94ca-c2d9231c32fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75df06a337bd4bed9c0f171bc9369ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:38:23Z,use_quota=True,user_id='e4bd32e7089d4665a0d6a0f5b2401681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d2d80d-5ce1-4854-9fe8-4bffb7944f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d2d80d-5ce1-4854-9fe8-4bffb7944f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e272582-14a9-4f74-838a-41dd14b23164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e272582-14a9-4f74-838a-41dd14b23164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1e918f-5c8e-40e2-94ca-c2d9231c32fb', 'volume_name': 'volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39251d36-eb02-4e5a-a6f4-01b2c89cf7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39251d36-eb02-4e5a-a6f4-01b2c89cf7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57f6d0f-ea20-4330-9893-6b544f0a4eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:38:23 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb', 'volume_size': 1} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-594190668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1e918f-5c8e-40e2-94ca-c2d9231c32fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75df06a337bd4bed9c0f171bc9369ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:38:23Z,use_quota=True,user_id='e4bd32e7089d4665a0d6a0f5b2401681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Creating volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:38:23 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:23 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb 1073741824 Sep 28 21:38:23 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:23 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb 1073741824" returned: 0 in 0.545s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:23 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb Sep 28 21:38:23 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:24 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" returned: 0 in 0.271s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:38:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57f6d0f-ea20-4330-9893-6b544f0a4eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:38:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1dbca1-1e71-4e68-8031-3f700876df02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:38:24 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Volume volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb (3f1e918f-5c8e-40e2-94ca-c2d9231c32fb): created successfully Sep 28 21:38:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1dbca1-1e71-4e68-8031-3f700876df02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:38:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Flow 'volume_create_manager' (441abd9f-7dc7-4b5a-9ff8-2350de286ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:38:24 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-17afc660-b7be-43e0-a8a2-b6742d3651b0 tempest-SnapshotsActionsTest-1567062539 None] Created volume successfully. Sep 28 21:38:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Creating offline snapshot 4ed7f78c-9b88-4fe9-9e47-d28773661373 of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:38:25 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83fa0a8-690b-4aba-8d43-19e3b0c92c1f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:25 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb Sep 28 21:38:25 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:26 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" returned: 0 in 0.418s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:26 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 1G Sep 28 21:38:26 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:26 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 1G" returned: 0 in 0.462s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:26 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:26 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:26 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.417s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:26 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 is being set with open permissions: ugo+rw Sep 28 21:38:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:26 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:26 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:27 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.413s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:27 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.info Sep 28 21:38:27 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:27 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.info" returned: 0 in 0.539s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:27 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.info is being set with open permissions: ugo+rw Sep 28 21:38:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:28 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.info Sep 28 21:38:28 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:28 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.info" returned: 0 in 0.366s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.789s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0d4175a2-20d7-4086-8042-380deaec4456 tempest-SnapshotsActionsTest-1567062539 None] Create snapshot completed successfully Sep 28 21:38:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Creating offline snapshot a87d5277-25fe-4de3-93ce-2f39b833f0a1 of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:38:29 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d82695-5d56-4d3c-b71f-dc7553cc3e3c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:30 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:30 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:30 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.650s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:30 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 1G Sep 28 21:38:30 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:31 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 1G" returned: 0 in 0.789s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:31 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 Sep 28 21:38:31 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:31 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1" returned: 0 in 0.424s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:31 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 is being set with open permissions: ugo+rw Sep 28 21:38:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:31 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 Sep 28 21:38:31 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:32 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1" returned: 0 in 0.383s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c7f6726f-edc1-4727-a9da-e48fbca8b560 tempest-SnapshotsActionsTest-1567062539 None] Create snapshot completed successfully Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-a87d5277-25fe-4de3-93ce-2f39b833f0a1-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-a87d5277-25fe-4de3-93ce-2f39b833f0a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-quobyte-a87d5277-25fe-4de3-93ce-2f39b833f0a1" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-a87d5277-25fe-4de3-93ce-2f39b833f0a1" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Deleting offline snapshot a87d5277-25fe-4de3-93ce-2f39b833f0a1 of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] snapshot_file for this snap is: volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[043c8300-7603-4669-b32f-ac3843da2a0d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:33 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 Sep 28 21:38:33 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:34 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1" returned: 0 in 0.558s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bafee2b-a364-4f64-a4e6-da6ca8d12b61]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:34 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:34 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:34 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.464s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:34 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 Sep 28 21:38:34 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:34 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1" returned: 0 in 0.465s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:35 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1 Sep 28 21:38:35 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:35 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.a87d5277-25fe-4de3-93ce-2f39b833f0a1" returned: 0 in 0.335s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-a87d5277-25fe-4de3-93ce-2f39b833f0a1" released by "_delete_snapshot" :: held 1.996s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" released by "delete_snapshot" :: held 2.052s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:35 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Created reservations ['d0e7d760-2beb-4270-bc1a-00123f820ce3', 'e27e4af9-e4fb-4465-aaff-d1adaab984f1', '94deda0d-05a8-4eb2-9c2e-4e0b5418bee4', 'e7f09546-6fbf-440d-b158-7e3a6e26a355'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:38:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Delete snapshot completed successfully. Sep 28 21:38:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f72ad732-6ccf-4d90-afca-061e63ec644d tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-a87d5277-25fe-4de3-93ce-2f39b833f0a1-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Creating offline snapshot fcbedd88-b9e0-4a8b-afe2-3645a6100aed of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:38:37 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff879b-b1d8-45a5-a2a5-b5ad33c9ee9a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:37 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:37 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:37 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.440s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:37 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed 1G Sep 28 21:38:37 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:38 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed 1G" returned: 0 in 0.546s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:38 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed Sep 28 21:38:38 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:38 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed" returned: 0 in 0.335s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:38 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed is being set with open permissions: ugo+rw Sep 28 21:38:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:38 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed Sep 28 21:38:38 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:38 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed" returned: 0 in 0.372s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d601be18-de61-44b6-8037-b6d36c50e6f6 tempest-SnapshotsActionsTest-1567062539 None] Create snapshot completed successfully Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-fcbedd88-b9e0-4a8b-afe2-3645a6100aed-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-fcbedd88-b9e0-4a8b-afe2-3645a6100aed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-quobyte-fcbedd88-b9e0-4a8b-afe2-3645a6100aed" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-fcbedd88-b9e0-4a8b-afe2-3645a6100aed" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Deleting offline snapshot fcbedd88-b9e0-4a8b-afe2-3645a6100aed of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] snapshot_file for this snap is: volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[627062a5-c870-4e0a-9acc-88674e1d3e05]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:40 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed Sep 28 21:38:40 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:40 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed" returned: 0 in 0.820s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad98324-1989-4cf9-a2b5-8ed008cd9ef6]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:40 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:40 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:41 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.708s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:41 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed Sep 28 21:38:41 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:42 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed" returned: 0 in 0.693s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:42 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed Sep 28 21:38:42 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:42 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.fcbedd88-b9e0-4a8b-afe2-3645a6100aed" returned: 0 in 0.419s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-fcbedd88-b9e0-4a8b-afe2-3645a6100aed" released by "_delete_snapshot" :: held 2.887s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" released by "delete_snapshot" :: held 2.952s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:42 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Created reservations ['df07e822-702f-444e-9862-33ae4e371ac0', '1a5574bb-ad46-4f13-b687-10295142d7f7', '171be626-d05c-4c1f-a58e-e8a085a77e24', '230da6ca-7035-4da9-98c1-0ccdf46a8869'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:38:43 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Delete snapshot completed successfully. Sep 28 21:38:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6973315e-6457-4cf1-95b5-22741189c3b6 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-fcbedd88-b9e0-4a8b-afe2-3645a6100aed-delete_snapshot" released by "delete_snapshot" :: held 3.495s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Creating offline snapshot ff1a53d0-2654-4ae7-b897-5388ea06bd18 of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:38:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c077d977-506a-4474-bd5b-5a80ccde860e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:44 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:44 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:44 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.765s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:44 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 1G Sep 28 21:38:44 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:45 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 1G" returned: 0 in 0.885s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:45 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 Sep 28 21:38:45 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:46 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18" returned: 0 in 0.625s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:46 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 is being set with open permissions: ugo+rw Sep 28 21:38:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:46 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 Sep 28 21:38:46 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:46 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18" returned: 0 in 0.372s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.892s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-160bc70b-95d9-4259-8562-5d5597e7934c tempest-SnapshotsActionsTest-1567062539 None] Create snapshot completed successfully Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-ff1a53d0-2654-4ae7-b897-5388ea06bd18-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-ff1a53d0-2654-4ae7-b897-5388ea06bd18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-quobyte-ff1a53d0-2654-4ae7-b897-5388ea06bd18" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-ff1a53d0-2654-4ae7-b897-5388ea06bd18" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Deleting offline snapshot ff1a53d0-2654-4ae7-b897-5388ea06bd18 of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] snapshot_file for this snap is: volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42d4f7-bfa1-40d3-baba-937b4e4396b5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:47 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 Sep 28 21:38:47 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:48 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18" returned: 0 in 1.024s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e02163-bb48-42b6-9ea3-db664be8c49a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:49 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:49 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:50 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 1.401s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:50 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 Sep 28 21:38:50 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:51 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18" returned: 0 in 1.031s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:51 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18 Sep 28 21:38:51 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:51 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.ff1a53d0-2654-4ae7-b897-5388ea06bd18" returned: 0 in 0.400s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-ff1a53d0-2654-4ae7-b897-5388ea06bd18" released by "_delete_snapshot" :: held 4.157s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" released by "delete_snapshot" :: held 4.199s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:51 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Created reservations ['cde1b502-5ead-4052-80ed-61964d4b5d94', '5a0e1008-2ec0-4bf2-a195-6c8c641860c7', '0972e05d-b3aa-4061-b581-55ece5393154', '3fb92a6c-903f-4092-b02b-0cdad51c1916'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:38:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Delete snapshot completed successfully. Sep 28 21:38:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-022e7f43-66bc-49ca-ba29-942db8926f77 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-ff1a53d0-2654-4ae7-b897-5388ea06bd18-delete_snapshot" released by "delete_snapshot" :: held 4.541s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:38:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:38:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:38:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Creating offline snapshot 4caf4f56-dc3c-4a2f-97a5-09abdd04a054 of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:38:54 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d594b96-c8a4-471b-ae02-9e8046be35ab]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:54 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:38:54 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:55 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 1.195s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:55 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:38:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:55 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 1G Sep 28 21:38:55 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:56 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 1G" returned: 0 in 1.300s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:56 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 Sep 28 21:38:56 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:57 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054" returned: 0 in 0.784s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:57 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 is being set with open permissions: ugo+rw Sep 28 21:38:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:38:57 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 Sep 28 21:38:57 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:38:58 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Sep 28 21:38:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054" returned: 0 in 0.618s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:38:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.167s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:38:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-624fb2d1-6379-4956-9694-d05fa26ba0fc tempest-SnapshotsActionsTest-1567062539 None] Create snapshot completed successfully Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-4caf4f56-dc3c-4a2f-97a5-09abdd04a054-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-4caf4f56-dc3c-4a2f-97a5-09abdd04a054-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Acquiring lock "cinder-quobyte-4caf4f56-dc3c-4a2f-97a5-09abdd04a054" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-4caf4f56-dc3c-4a2f-97a5-09abdd04a054" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Deleting offline snapshot 4caf4f56-dc3c-4a2f-97a5-09abdd04a054 of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] snapshot_file for this snap is: volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1a1c60-deb1-4425-bb0f-7d8b1b034db5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:38:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:00 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 Sep 28 21:39:00 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:00 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054" returned: 0 in 0.718s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:39:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d707a513-a6b0-4ad9-b6ca-8d565e10ce8e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:00 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:39:00 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:01 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.570s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:39:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:01 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 Sep 28 21:39:01 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:02 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054" returned: 0 in 0.829s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:02 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054 Sep 28 21:39:02 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Flow 'volume_create_manager' (384f230a-7f20-477f-a1a8-5a6267ba250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da68054-bdab-4416-9bf8-df0bcd9d2941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da68054-bdab-4416-9bf8-df0bcd9d2941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1948495486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e23d57-c075-4e08-a7ca-3cec51d45bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78712f0e25ec4444835388a1fa529d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:03Z,use_quota=True,user_id='09ab38175b12416eaae4beba8eff765a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3d9fcc-d534-4e8c-b785-b64c7301efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:02 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3d9fcc-d534-4e8c-b785-b64c7301efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e493f32-3a42-42b8-9269-9225523469a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e493f32-3a42-42b8-9269-9225523469a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e23d57-c075-4e08-a7ca-3cec51d45bb1', 'volume_name': 'volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a4cb9d-b5c4-4943-8312-1c989736e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a4cb9d-b5c4-4943-8312-1c989736e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bacf33-c329-40e8-be73-acf66ff8e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:02 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Volume 96e23d57-c075-4e08-a7ca-3cec51d45bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1', 'volume_size': 1} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1948495486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e23d57-c075-4e08-a7ca-3cec51d45bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78712f0e25ec4444835388a1fa529d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:03Z,use_quota=True,user_id='09ab38175b12416eaae4beba8eff765a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Creating volume 96e23d57-c075-4e08-a7ca-3cec51d45bb1 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:39:02 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4caf4f56-dc3c-4a2f-97a5-09abdd04a054" returned: 0 in 0.720s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:02 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 1073741824 Sep 28 21:39:02 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-4caf4f56-dc3c-4a2f-97a5-09abdd04a054" released by "_delete_snapshot" :: held 3.113s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" released by "delete_snapshot" :: held 3.165s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Created reservations ['b649d3bb-1ea8-494d-b0b1-5ee35bc8ae96', 'bf516cca-dc15-4e3f-90f3-3bcb44314cc6', '78f455af-7d31-49c3-9468-e291e58ee18d', 'f4426faf-4ef4-49bb-8cd1-68ba6387c603'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:39:03 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Delete snapshot completed successfully. Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-71024180-3021-4186-b07a-19345e1829a7 tempest-SnapshotsActionsTest-2010760658 None] Lock "cinder-4caf4f56-dc3c-4a2f-97a5-09abdd04a054-delete_snapshot" released by "delete_snapshot" :: held 3.492s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:03 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 1073741824" returned: 0 in 0.754s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:03 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 Sep 28 21:39:03 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Flow 'volume_create_manager' (2ac45180-5028-47e2-947c-44125a3d0ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58125d41-cbfa-4590-a99a-4f1d77f79954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58125d41-cbfa-4590-a99a-4f1d77f79954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-751310900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67500b11-77fb-4285-b7f5-5af050e6dc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c84f66af9e454a94b0a327fa0b27ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:04Z,use_quota=True,user_id='b6da1140da4b41f2b3a4bc152c6e990e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e16c5e8d-81ff-4fee-a101-839bf806ee47),volume_type_id=e16c5e8d-81ff-4fee-a101-839bf806ee47)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f955246-9c98-47b4-aa56-ae12600bd40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f955246-9c98-47b4-aa56-ae12600bd40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfaf6c9-1f56-446d-89e9-04df1c14151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfaf6c9-1f56-446d-89e9-04df1c14151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67500b11-77fb-4285-b7f5-5af050e6dc79', 'volume_name': 'volume-67500b11-77fb-4285-b7f5-5af050e6dc79', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d906444e-e0b3-4630-914b-3df6cfbc8564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d906444e-e0b3-4630-914b-3df6cfbc8564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ada0fd9-5b63-4b20-a7ba-338547298259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:03 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume 67500b11-77fb-4285-b7f5-5af050e6dc79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67500b11-77fb-4285-b7f5-5af050e6dc79', 'volume_size': 1} Sep 28 21:39:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:04 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1" returned: 0 in 0.548s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.235s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-751310900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67500b11-77fb-4285-b7f5-5af050e6dc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c84f66af9e454a94b0a327fa0b27ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:04Z,use_quota=True,user_id='b6da1140da4b41f2b3a4bc152c6e990e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e16c5e8d-81ff-4fee-a101-839bf806ee47),volume_type_id=e16c5e8d-81ff-4fee-a101-839bf806ee47)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Creating volume 67500b11-77fb-4285-b7f5-5af050e6dc79 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:39:04 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bacf33-c329-40e8-be73-acf66ff8e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ee9a08-94b2-44fd-a204-62d78a7c75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:04 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 1073741824 Sep 28 21:39:04 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:04 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Volume volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 (96e23d57-c075-4e08-a7ca-3cec51d45bb1): created successfully Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ee9a08-94b2-44fd-a204-62d78a7c75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Flow 'volume_create_manager' (384f230a-7f20-477f-a1a8-5a6267ba250f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6077ec34-c11c-4800-b2cc-926c8fc6400b tempest-ServerRescueNegativeTestJSON-552291182 None] Created volume successfully. Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Flow 'volume_create_manager' (24cd730c-ae04-40a3-bb8d-6dad0591b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5667959-2116-425f-8e94-47a87b3f0d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5667959-2116-425f-8e94-47a87b3f0d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1599835131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c3b140-8863-4ed8-b9d0-faed905f4fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c84f66af9e454a94b0a327fa0b27ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:04Z,use_quota=True,user_id='b6da1140da4b41f2b3a4bc152c6e990e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(225c2cec-5472-4acb-b001-b25b3476e338),volume_type_id=225c2cec-5472-4acb-b001-b25b3476e338)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975c208b-3f33-4f4d-8030-c4d2a0d9b670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975c208b-3f33-4f4d-8030-c4d2a0d9b670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64606a9d-1f39-4a59-8ea7-9dd986e738a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64606a9d-1f39-4a59-8ea7-9dd986e738a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c3b140-8863-4ed8-b9d0-faed905f4fc3', 'volume_name': 'volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00987a7f-3562-4635-b71a-3c6a08bfe929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00987a7f-3562-4635-b71a-3c6a08bfe929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a6559a-b6f7-483e-b038-d17765b5a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:04 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume f3c3b140-8863-4ed8-b9d0-faed905f4fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3', 'volume_size': 1} Sep 28 21:39:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "cinder-4ed7f78c-9b88-4fe9-9e47-d28773661373-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-4ed7f78c-9b88-4fe9-9e47-d28773661373-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "cinder-quobyte-4ed7f78c-9b88-4fe9-9e47-d28773661373" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-quobyte-4ed7f78c-9b88-4fe9-9e47-d28773661373" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Deleting offline snapshot 4ed7f78c-9b88-4fe9-9e47-d28773661373 of volume 3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] snapshot_file for this snap is: volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4653609a-cff4-498b-b6d1-b3adca99fcff]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:05 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 1073741824" returned: 0 in 1.392s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:05 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 Sep 28 21:39:05 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:05 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:39:05 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:39:06 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Flow 'volume_create_manager' (9da735b7-6757-40a5-a998-656cf3f6a573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed96ebda-9c1d-420d-ad5d-ea36fbe6c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79" returned: 0 in 0.580s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1599835131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c3b140-8863-4ed8-b9d0-faed905f4fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c84f66af9e454a94b0a327fa0b27ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:04Z,use_quota=True,user_id='b6da1140da4b41f2b3a4bc152c6e990e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(225c2cec-5472-4acb-b001-b25b3476e338),volume_type_id=225c2cec-5472-4acb-b001-b25b3476e338)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Creating volume f3c3b140-8863-4ed8-b9d0-faed905f4fc3 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:39:06 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed96ebda-9c1d-420d-ad5d-ea36fbe6c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1562194006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83349bbf-871e-4750-91ae-e83a564e3665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c84f66af9e454a94b0a327fa0b27ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:06Z,use_quota=True,user_id='b6da1140da4b41f2b3a4bc152c6e990e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a95698b-b2cc-45e8-906a-35478bc66323),volume_type_id=2a95698b-b2cc-45e8-906a-35478bc66323)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbad2d3-aab6-4d35-bd56-2cc7a9d64d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbad2d3-aab6-4d35-bd56-2cc7a9d64d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dde968-8843-49a9-a688-6cecfe200253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:39:06 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 1073741824 Sep 28 21:39:06 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ada0fd9-5b63-4b20-a7ba-338547298259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67500b11-77fb-4285-b7f5-5af050e6dc79', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ff10fc-3419-4e27-a34f-8984029af95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:06 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume volume-67500b11-77fb-4285-b7f5-5af050e6dc79 (67500b11-77fb-4285-b7f5-5af050e6dc79): created successfully Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ff10fc-3419-4e27-a34f-8984029af95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Flow 'volume_create_manager' (2ac45180-5028-47e2-947c-44125a3d0ea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:06 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 1.007s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa8eb3-d46c-40a2-b982-e775a404b880]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-443e4f9f-06bf-4082-989e-1cacc0486703 tempest-TestInstancesWithCinderVolumes-1372769237 None] Created volume successfully. Sep 28 21:39:06 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb Sep 28 21:39:06 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dde968-8843-49a9-a688-6cecfe200253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83349bbf-871e-4750-91ae-e83a564e3665', 'volume_name': 'volume-83349bbf-871e-4750-91ae-e83a564e3665', 'volume_size': 1, 'image_id': 'b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--974867129', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '11c84f66af9e454a94b0a327fa0b27ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'created_at': datetime.datetime(2026, 9, 28, 19, 38, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 39, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff/file', 'properties': {}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1acd601-8b2e-4974-8a69-35a8cc106280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1acd601-8b2e-4974-8a69-35a8cc106280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8f2d6d-c043-4a05-b7da-11cfc019bde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume 83349bbf-871e-4750-91ae-e83a564e3665: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83349bbf-871e-4750-91ae-e83a564e3665', 'volume_size': 1, 'image_id': 'b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--974867129', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '11c84f66af9e454a94b0a327fa0b27ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'created_at': datetime.datetime(2026, 9, 28, 19, 38, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 39, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff/file', 'properties': {}}, 'image_service': } Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Trying to clone 83349bbf-871e-4750-91ae-e83a564e3665 from image b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff at location (None, [{'url': 'file:///opt/stack/data/glance/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:07 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" returned: 0 in 0.840s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:07 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:39:07 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:07 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:39:07 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:07 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 1073741824" returned: 0 in 1.310s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:07 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 Sep 28 21:39:07 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:08 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.568s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 28 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:39:08 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.892s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:08 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373 Sep 28 21:39:08 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:08 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3" returned: 0 in 0.677s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a6559a-b6f7-483e-b038-d17765b5a41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc34706-f2b7-43cb-ae4b-64a188bf360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:08 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 (f3c3b140-8863-4ed8-b9d0-faed905f4fc3): created successfully Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc34706-f2b7-43cb-ae4b-64a188bf360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Flow 'volume_create_manager' (24cd730c-ae04-40a3-bb8d-6dad0591b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9e9c495e-57ce-453a-9613-2f61128dd6a3 tempest-TestInstancesWithCinderVolumes-1372769237 None] Created volume successfully. Sep 28 21:39:08 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb.4ed7f78c-9b88-4fe9-9e47-d28773661373" returned: 0 in 0.400s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-quobyte-4ed7f78c-9b88-4fe9-9e47-d28773661373" released by "_delete_snapshot" :: held 3.421s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" released by "delete_snapshot" :: held 3.498s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:09 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Created reservations ['b8fe84e6-b3dd-4a23-b7ba-2ee6c9083fc0', 'c3a66076-e00f-4f6e-856e-3eb7eb91d0df', 'f6159a56-b882-4bd6-8547-660254cde6ff', '006d0964-486d-42e7-ae84-9b6fb379f30f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:39:09 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Delete snapshot completed successfully. Sep 28 21:39:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4bcd40e-ed7d-4137-8591-da893aa62ce5 tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-4ed7f78c-9b88-4fe9-9e47-d28773661373-delete_snapshot" released by "delete_snapshot" :: held 3.863s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "cinder-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:10 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0465b81-b9e5-4fed-b854-fe553865f7e4]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:10 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb Sep 28 21:39:10 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:10 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" returned: 0 in 0.629s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:10 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb Sep 28 21:39:10 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:11 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" returned: 0 in 0.524s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-quobyte-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb" released by "delete_volume" :: held 1.244s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Created reservations ['b1b5c85c-5b51-4ec2-91f6-919ee84a7742', 'd677fb18-a862-4a75-8359-192e932c918f', 'd0bd21ad-5752-4fbc-9316-ebde824e82dc', '740efdc5-0349-4e14-be71-495fbaebe3e5'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:11 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:39:11 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:11 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.355s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:39:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Deleted volume successfully. Sep 28 21:39:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd15791c-c680-45f5-8274-0d982f37420c tempest-SnapshotsActionsTest-1567062539 None] Lock "cinder-3f1e918f-5c8e-40e2-94ca-c2d9231c32fb-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:13 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD, size 20.69 MB, duration 6.18 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:39:13 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Image download 20.69 MB at 3.35 MB/s Sep 28 21:39:13 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b4967-b1e6-4c95-8546-a83fc21b195d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:13 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD Sep 28 21:39:13 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:14 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD" returned: 0 in 0.532s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:14 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Temporary image b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff is fetched for user b6da1140da4b41f2b3a4bc152c6e990e. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:39:14 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[01786114-106c-4526-b8f3-885bd5dca027]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:14 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD Sep 28 21:39:14 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:15 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD" returned: 0 in 0.657s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1562194006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83349bbf-871e-4750-91ae-e83a564e3665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c84f66af9e454a94b0a327fa0b27ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:06Z,use_quota=True,user_id='b6da1140da4b41f2b3a4bc152c6e990e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a95698b-b2cc-45e8-906a-35478bc66323),volume_type_id=2a95698b-b2cc-45e8-906a-35478bc66323)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Creating volume 83349bbf-871e-4750-91ae-e83a564e3665 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:39:15 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:15 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 1073741824 Sep 28 21:39:15 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:15 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 1073741824" returned: 0 in 0.677s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:15 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 Sep 28 21:39:15 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:16 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665" returned: 0 in 0.325s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:39:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:16 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Attempting download of b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff ((None, [{'url': 'file:///opt/stack/data/glance/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'metadata': {}}])) to volume 83349bbf-871e-4750-91ae-e83a564e3665. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:39:16 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd79d8de-48be-4326-88eb-8fb05a4039ef]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_g02q6bz6 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:16 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_g02q6bz6 Sep 28 21:39:16 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:16 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_g02q6bz6" returned: 0 in 0.422s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_g02q6bz6 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:16 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_g02q6bz6 Sep 28 21:39:16 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:17 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_g02q6bz6" returned: 1 in 0.443s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_g02q6bz6' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:39:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[857e7b31-3665-4c90-b681-5e71a15991e8]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:17 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD Sep 28 21:39:17 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:17 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:17 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff was qcow2, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:39:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:17 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 Sep 28 21:39:17 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Acquiring lock "cinder-96e23d57-c075-4e08-a7ca-3cec51d45bb1-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "cinder-96e23d57-c075-4e08-a7ca-3cec51d45bb1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:19 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=59,cinder:UPDATE=53,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:39:19 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=49,cinder:UPDATE=60,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:39:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Acquiring lock "cinder-quobyte-96e23d57-c075-4e08-a7ca-3cec51d45bb1" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "cinder-quobyte-96e23d57-c075-4e08-a7ca-3cec51d45bb1" acquired by "delete_volume" :: waited 0.052s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:19 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a1ae04-4fea-4f52-ac55-27543ce3bab9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:19 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 Sep 28 21:39:19 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Flow 'volume_create_manager' (ddc84909-da9a-4e50-8512-fd37badc92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a563f55-aadc-4cc2-9b23-054edb60702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a563f55-aadc-4cc2-9b23-054edb60702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1671981810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dc6933-c88c-4577-b865-fa67ae631746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a855b6ca7c74917801c3d23b4e480d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:20Z,use_quota=True,user_id='3da903def67d450584835d61f7411cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:20 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475ec5b6-4dd3-49ad-afbf-5e73af82b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475ec5b6-4dd3-49ad-afbf-5e73af82b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684bc473-657e-4792-8012-cefa717b1b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684bc473-657e-4792-8012-cefa717b1b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45dc6933-c88c-4577-b865-fa67ae631746', 'volume_name': 'volume-45dc6933-c88c-4577-b865-fa67ae631746', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc11a77-3ac2-4c18-82c6-ec12851b14e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc11a77-3ac2-4c18-82c6-ec12851b14e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247dcabd-470e-4331-b13b-72deac683ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:20 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Volume 45dc6933-c88c-4577-b865-fa67ae631746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45dc6933-c88c-4577-b865-fa67ae631746', 'volume_size': 1} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1671981810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dc6933-c88c-4577-b865-fa67ae631746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a855b6ca7c74917801c3d23b4e480d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:20Z,use_quota=True,user_id='3da903def67d450584835d61f7411cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Creating volume 45dc6933-c88c-4577-b865-fa67ae631746 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:39:20 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1" returned: 0 in 0.839s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:20 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 1073741824 Sep 28 21:39:20 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:20 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1 Sep 28 21:39:20 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:20 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665" returned: 0 in 3.145s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff_todyqax7devstack@QuobyteHD, size 112.00 MB, duration 3.15 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:39:20 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Converted 112.00 MB image at 35.55 MB/s Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:20 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 1G Sep 28 21:39:20 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:20 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-96e23d57-c075-4e08-a7ca-3cec51d45bb1" returned: 0 in 0.457s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "cinder-quobyte-96e23d57-c075-4e08-a7ca-3cec51d45bb1" released by "delete_volume" :: held 1.416s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:20 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Created reservations ['a547364f-19cb-4367-a78c-57a515698b13', '3dd00d1e-d943-4c57-9c43-5090759adc1b', '1e4babf1-c1cd-44b2-85a5-20914e4eb3e6', 'aaa38843-a2bc-4b82-903e-9295bc228fc0'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:21 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:39:21 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:21 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 1073741824" returned: 0 in 0.927s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:21 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 Sep 28 21:39:21 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:21 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 1G" returned: 0 in 0.653s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Downloaded image b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff ((None, [{'url': 'file:///opt/stack/data/glance/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'metadata': {}}])) to volume 83349bbf-871e-4750-91ae-e83a564e3665 successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Temporary image b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff for user b6da1140da4b41f2b3a4bc152c6e990e is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Marking volume 83349bbf-871e-4750-91ae-e83a564e3665 as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:39:21 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.307s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:39:21 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Deleted volume successfully. Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Copying metadata from image b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff to 83349bbf-871e-4750-91ae-e83a564e3665. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Creating volume glance metadata for volume 83349bbf-871e-4750-91ae-e83a564e3665 backed by image b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff with: {'image_id': 'b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'image_name': 'tempest-scenario-img--974867129', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8105128d-5d14-42b4-a599-21f02fb84fd9 tempest-ServerRescueNegativeTestJSON-552291182 None] Lock "cinder-96e23d57-c075-4e08-a7ca-3cec51d45bb1-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8f2d6d-c043-4a05-b7da-11cfc019bde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83349bbf-871e-4750-91ae-e83a564e3665', 'volume_size': 1, 'image_id': 'b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--974867129', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '11c84f66af9e454a94b0a327fa0b27ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff', 'created_at': datetime.datetime(2026, 9, 28, 19, 38, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 39, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ac2cfd-7e40-4975-bb2d-9e4a0a0a1cff/file', 'properties': {}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e72b1e-b735-4437-b410-a584de0e3e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Volume volume-83349bbf-871e-4750-91ae-e83a564e3665 (83349bbf-871e-4750-91ae-e83a564e3665): created successfully Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e72b1e-b735-4437-b410-a584de0e3e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Flow 'volume_create_manager' (9da735b7-6757-40a5-a998-656cf3f6a573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:21 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9266f96e-477e-49f2-aec2-21368fadeec6 tempest-TestInstancesWithCinderVolumes-1372769237 None] Created volume successfully. Sep 28 21:39:21 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746" returned: 0 in 0.558s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247dcabd-470e-4331-b13b-72deac683ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dc6933-c88c-4577-b865-fa67ae631746', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a408cbba-7490-4441-be67-c51d238a0d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Volume volume-45dc6933-c88c-4577-b865-fa67ae631746 (45dc6933-c88c-4577-b865-fa67ae631746): created successfully Sep 28 21:39:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a408cbba-7490-4441-be67-c51d238a0d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Flow 'volume_create_manager' (ddc84909-da9a-4e50-8512-fd37badc92f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:22 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b8ed65de-0e22-4f94-a5d8-14bf300a4495 tempest-AttachVolumeTestJSON-1772433899 None] Created volume successfully. Sep 28 21:39:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-5c561cab-f877-49cf-9b4c-8d4cada2a148 req-2d7ed22e-5785-4875-8c8a-a79a27e412df tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-5c561cab-f877-49cf-9b4c-8d4cada2a148 req-2d7ed22e-5785-4875-8c8a-a79a27e412df tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-5c561cab-f877-49cf-9b4c-8d4cada2a148 req-2d7ed22e-5785-4875-8c8a-a79a27e412df tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.065s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-5c561cab-f877-49cf-9b4c-8d4cada2a148 req-2d7ed22e-5785-4875-8c8a-a79a27e412df tempest-AttachVolumeTestJSON-1772433899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-45dc6933-c88c-4577-b865-fa67ae631746', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd44b1a96-5cf7-4841-8c1a-7e6b088d2036', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:39:24 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-5c561cab-f877-49cf-9b4c-8d4cada2a148 req-2d7ed22e-5785-4875-8c8a-a79a27e412df tempest-AttachVolumeTestJSON-1772433899 None] attachment_update completed successfully. Sep 28 21:39:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-a0343c01-21c2-49c4-bf73-13cc664b37d8 req-7478a8f6-40cd-4510-9f7f-ee18e96ea21e tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-a0343c01-21c2-49c4-bf73-13cc664b37d8 req-7478a8f6-40cd-4510-9f7f-ee18e96ea21e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-a0343c01-21c2-49c4-bf73-13cc664b37d8 req-7478a8f6-40cd-4510-9f7f-ee18e96ea21e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-a0343c01-21c2-49c4-bf73-13cc664b37d8 req-7478a8f6-40cd-4510-9f7f-ee18e96ea21e tempest-TestInstancesWithCinderVolumes-1372769237 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-83349bbf-871e-4750-91ae-e83a564e3665', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8b6c3e9-e5e1-47cc-a095-1f4a2712b7cc', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:39:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-a0343c01-21c2-49c4-bf73-13cc664b37d8 req-7478a8f6-40cd-4510-9f7f-ee18e96ea21e tempest-TestInstancesWithCinderVolumes-1372769237 None] attachment_update completed successfully. Sep 28 21:39:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=17,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:39:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=26,cinder:UPDATE=14,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Flow 'volume_create_manager' (5b176fd8-1384-47c6-a3de-5fe7459ad497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c1b5a2-d875-45e3-aaa2-bb0f5c39067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c1b5a2-d875-45e3-aaa2-bb0f5c39067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1148012122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cc2602-919b-4c94-83a6-5e4d44d2e2c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce4567f738cf4628a8d0012212fd07b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:47Z,use_quota=True,user_id='6cd2278935af41dc97f5f73fe6b99574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7f4512-08a0-49b0-b4c0-4cbd58be6452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7f4512-08a0-49b0-b4c0-4cbd58be6452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c99208-c63b-43ff-85f4-b0e6f81fd9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c99208-c63b-43ff-85f4-b0e6f81fd9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07cc2602-919b-4c94-83a6-5e4d44d2e2c2', 'volume_name': 'volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd10dbc-29b9-43cf-9383-595b2b3a220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd10dbc-29b9-43cf-9383-595b2b3a220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e191ad7a-56e8-4252-9682-cefc9f46b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:46 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Volume 07cc2602-919b-4c94-83a6-5e4d44d2e2c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2', 'volume_size': 1} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1148012122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cc2602-919b-4c94-83a6-5e4d44d2e2c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce4567f738cf4628a8d0012212fd07b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:47Z,use_quota=True,user_id='6cd2278935af41dc97f5f73fe6b99574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Creating volume 07cc2602-919b-4c94-83a6-5e4d44d2e2c2 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:39:46 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:39:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Flow 'volume_create_manager' (36b3aa7d-dd07-4888-9fbd-f23a230b8c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b797806a-1c23-4028-9704-9931e4ab0b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:47 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 1073741824 Sep 28 21:39:47 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b797806a-1c23-4028-9704-9931e4ab0b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-903371170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7537854-1082-41f8-968f-1efb5b467253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acbfc55bd6844a798b5ca21460d077a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:47Z,use_quota=True,user_id='060a3ba5f79c4ad2b91000c12d42f975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b20df04-e67e-4fef-aa2b-0a8147dfa637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b20df04-e67e-4fef-aa2b-0a8147dfa637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbc8c6b-c2d9-461e-9e99-0d7262f998f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbc8c6b-c2d9-461e-9e99-0d7262f998f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a7537854-1082-41f8-968f-1efb5b467253', 'volume_name': 'volume-a7537854-1082-41f8-968f-1efb5b467253', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de91c1fa-a858-4989-8f2c-27ed45ed62af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de91c1fa-a858-4989-8f2c-27ed45ed62af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3d6ec5-fd58-4d22-a2eb-7f409a0bed98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:47 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Volume a7537854-1082-41f8-968f-1efb5b467253: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a7537854-1082-41f8-968f-1efb5b467253', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Trying to clone a7537854-1082-41f8-968f-1efb5b467253 from image 3995c6d3-b961-4789-8642-3546544acbf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:39:47 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 1073741824" returned: 0 in 0.930s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:48 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 Sep 28 21:39:48 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:39:48 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Image download 20.69 MB at 20.69 MB/s Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[340b1213-660a-4816-8e32-1e787250caec]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:48 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2" returned: 0 in 0.665s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e191ad7a-56e8-4252-9682-cefc9f46b90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d2de53-8f83-40d8-91a0-d9121a3b413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Volume volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 (07cc2602-919b-4c94-83a6-5e4d44d2e2c2): created successfully Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d2de53-8f83-40d8-91a0-d9121a3b413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Flow 'volume_create_manager' (5b176fd8-1384-47c6-a3de-5fe7459ad497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-ac3622cf-0862-4b35-826d-7c8781211c8d req-e410f637-8f4b-463f-a84d-adbe692c6fc1 tempest-VolumesGetTestJSON-1112909505 None] Created volume successfully. Sep 28 21:39:48 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD Sep 28 21:39:48 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:49 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 is fetched for user 060a3ba5f79c4ad2b91000c12d42f975. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6247cad8-1ba6-4db8-bdc2-fc4a7ca25b1a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:49 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD Sep 28 21:39:49 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:49 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-903371170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7537854-1082-41f8-968f-1efb5b467253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acbfc55bd6844a798b5ca21460d077a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:39:47Z,use_quota=True,user_id='060a3ba5f79c4ad2b91000c12d42f975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Creating volume a7537854-1082-41f8-968f-1efb5b467253 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:39:49 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:39:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:49 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 1073741824 Sep 28 21:39:49 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:50 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 1073741824" returned: 0 in 0.830s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Acquiring lock "cinder-07cc2602-919b-4c94-83a6-5e4d44d2e2c2-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Lock "cinder-07cc2602-919b-4c94-83a6-5e4d44d2e2c2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:50 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 Sep 28 21:39:50 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Acquiring lock "cinder-quobyte-07cc2602-919b-4c94-83a6-5e4d44d2e2c2" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Lock "cinder-quobyte-07cc2602-919b-4c94-83a6-5e4d44d2e2c2" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eeef45-8480-43e7-a681-01978770cbfb]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:50 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253" returned: 0 in 0.342s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:50 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 Sep 28 21:39:50 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:50 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Attempting download of 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume a7537854-1082-41f8-968f-1efb5b467253. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[95183ab0-6b3d-4c84-85ad-808a73556fb1]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_7sjw83b0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:51 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_7sjw83b0 Sep 28 21:39:51 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:51 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2" returned: 0 in 0.500s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:51 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2 Sep 28 21:39:51 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:51 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-07cc2602-919b-4c94-83a6-5e4d44d2e2c2" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Lock "cinder-quobyte-07cc2602-919b-4c94-83a6-5e4d44d2e2c2" released by "delete_volume" :: held 0.827s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:51 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_7sjw83b0" returned: 0 in 0.509s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_7sjw83b0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG cinder.quota [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Created reservations ['9a59b8d7-2668-4c77-b3e2-0796160f8087', '0d988616-4c83-4abe-a204-3c0ed6b510d6', 'bb9c2672-4725-4e1e-94a8-b1f54d8d8396', '0dcc0c49-ee87-4d52-bb2b-f54854b49d44'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:51 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_7sjw83b0 Sep 28 21:39:51 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:51 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:39:51 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:52 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_7sjw83b0" returned: 1 in 0.466s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_7sjw83b0' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca33999-cbc7-46d1-bb32-9431c3b91d7b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:52 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD Sep 28 21:39:52 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:52 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.465s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG cinder.manager [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:39:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Deleted volume successfully. Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-5b2f9d25-0e98-4b58-b619-c64d1e17c1d6 req-2a408f67-8119-4109-8873-54c8c6ce8e4a tempest-VolumesGetTestJSON-1112909505 None] Lock "cinder-07cc2602-919b-4c94-83a6-5e4d44d2e2c2-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:52 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] 3995c6d3-b961-4789-8642-3546544acbf3 was qcow2, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:39:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:52 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 Sep 28 21:39:52 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:55 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253" returned: 0 in 2.585s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_egm7hboddevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:39:55 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Converted 112.00 MB image at 43.31 MB/s Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:55 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 1G Sep 28 21:39:55 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:55 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 1G" returned: 0 in 0.427s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Downloaded image 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume a7537854-1082-41f8-968f-1efb5b467253 successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 for user 060a3ba5f79c4ad2b91000c12d42f975 is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Marking volume a7537854-1082-41f8-968f-1efb5b467253 as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Copying metadata from image 3995c6d3-b961-4789-8642-3546544acbf3 to a7537854-1082-41f8-968f-1efb5b467253. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Creating volume glance metadata for volume a7537854-1082-41f8-968f-1efb5b467253 backed by image 3995c6d3-b961-4789-8642-3546544acbf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3d6ec5-fd58-4d22-a2eb-7f409a0bed98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7537854-1082-41f8-968f-1efb5b467253', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0f0ec4-0db0-4cf5-a46f-5225c2afbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:39:55 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Volume volume-a7537854-1082-41f8-968f-1efb5b467253 (a7537854-1082-41f8-968f-1efb5b467253): created successfully Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0f0ec4-0db0-4cf5-a46f-5225c2afbf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:39:55 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Flow 'volume_create_manager' (36b3aa7d-dd07-4888-9fbd-f23a230b8c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:39:55 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c052428e-4b66-48e5-8084-96ad5997af95 tempest-VolumesImageMetadata-1485530373 None] Created volume successfully. Sep 28 21:39:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Acquiring lock "cinder-a7537854-1082-41f8-968f-1efb5b467253-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Lock "cinder-a7537854-1082-41f8-968f-1efb5b467253-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Acquiring lock "cinder-quobyte-a7537854-1082-41f8-968f-1efb5b467253" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:39:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Lock "cinder-quobyte-a7537854-1082-41f8-968f-1efb5b467253" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fa4aa5-2792-4b5d-9fa1-17388e2cc213]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:57 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 Sep 28 21:39:57 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:57 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253" returned: 0 in 0.362s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:57 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253 Sep 28 21:39:57 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-649603f1-72f7-45ad-8155-930812273e07 tempest-BackendsCapabilitiesAdminTestsJSON-690418043 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.050682067871, 'free_capacity_gb': 1775.050682067871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86489) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a895261c-eb24-49df-aeb7-de6e46165203 tempest-BackendsCapabilitiesAdminTestsJSON-690418043 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.050682067871, 'free_capacity_gb': 1775.050682067871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86489) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 21:39:57 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a7537854-1082-41f8-968f-1efb5b467253" returned: 0 in 0.260s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Lock "cinder-quobyte-a7537854-1082-41f8-968f-1efb5b467253" released by "delete_volume" :: held 0.675s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Created reservations ['f8359586-5a34-4121-b45f-9c35184fba30', '5f013cdf-5f8d-401a-87e6-eff6202b6330', '9280e116-42be-49c9-b62e-f3933fced939', 'b9833706-2095-40a6-8b61-b37f15196706'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:39:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:39:57 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:39:57 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:39:58 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Sep 28 21:39:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.268s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:39:58 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:39:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Deleted volume successfully. Sep 28 21:39:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3e5e415a-5f9a-4d1a-a6a7-11d6fbad87d1 tempest-VolumesImageMetadata-1485530373 None] Lock "cinder-a7537854-1082-41f8-968f-1efb5b467253-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-50887be9-70b8-4e99-9216-ad047c84a0b0 tempest-GroupSnapshotsTest-659546145 None] Group tempest-GroupSnapshotsTest-Group-1395340541: creating Sep 28 21:40:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-50887be9-70b8-4e99-9216-ad047c84a0b0 tempest-GroupSnapshotsTest-659546145 None] Group tempest-GroupSnapshotsTest-Group-1395340541: created successfully Sep 28 21:40:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-50887be9-70b8-4e99-9216-ad047c84a0b0 tempest-GroupSnapshotsTest-659546145 None] Create group completed successfully. Sep 28 21:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-27d8b7aa-a639-47f6-b91e-8398dd9491d8 req-e7422601-92b5-4497-8d5e-52ac90459eda tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-27d8b7aa-a639-47f6-b91e-8398dd9491d8 req-e7422601-92b5-4497-8d5e-52ac90459eda tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-27d8b7aa-a639-47f6-b91e-8398dd9491d8 req-e7422601-92b5-4497-8d5e-52ac90459eda tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-27d8b7aa-a639-47f6-b91e-8398dd9491d8 req-e7422601-92b5-4497-8d5e-52ac90459eda tempest-TestInstancesWithCinderVolumes-1372769237 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-67500b11-77fb-4285-b7f5-5af050e6dc79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d9183ea-8f4c-4e68-ac25-4c2cd96bf7cc', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:40:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-27d8b7aa-a639-47f6-b91e-8398dd9491d8 req-e7422601-92b5-4497-8d5e-52ac90459eda tempest-TestInstancesWithCinderVolumes-1372769237 None] attachment_update completed successfully. Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Flow 'volume_create_manager' (ff3a7879-4135-483b-9f20-94a56bf84175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5669331b-3eba-4162-b59b-4b562cb36617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5669331b-3eba-4162-b59b-4b562cb36617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2120331222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77168e31-c94a-4800-ac3f-4adf2caad395,host='devstack@QuobyteHD#QuobyteHD',id=e894ee6a-1abd-4038-8dcd-f0da667abda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29be7e6d59684794ac8a4a20e43c239d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:07Z,use_quota=True,user_id='ad6137ec18b143f796e74a58c2f9f167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(122ee9d2-ffed-4453-8f24-145acd9a76d6),volume_type_id=122ee9d2-ffed-4453-8f24-145acd9a76d6)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbeb67b-e640-4a46-97cc-45d149394cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbeb67b-e640-4a46-97cc-45d149394cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8bb24c-879f-4ea2-97e3-dc7c09fe1991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8bb24c-879f-4ea2-97e3-dc7c09fe1991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e894ee6a-1abd-4038-8dcd-f0da667abda0', 'volume_name': 'volume-e894ee6a-1abd-4038-8dcd-f0da667abda0', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0929164-4c02-4048-a568-2bd21597725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0929164-4c02-4048-a568-2bd21597725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89eeadf-5037-490c-9e9f-94a3773ccc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:06 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Volume e894ee6a-1abd-4038-8dcd-f0da667abda0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e894ee6a-1abd-4038-8dcd-f0da667abda0', 'volume_size': 1} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77168e31-c94a-4800-ac3f-4adf2caad395,created_at=2026-09-28T19:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2120331222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77168e31-c94a-4800-ac3f-4adf2caad395,host='devstack@QuobyteHD#QuobyteHD',id=e894ee6a-1abd-4038-8dcd-f0da667abda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29be7e6d59684794ac8a4a20e43c239d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:07Z,use_quota=True,user_id='ad6137ec18b143f796e74a58c2f9f167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(122ee9d2-ffed-4453-8f24-145acd9a76d6),volume_type_id=122ee9d2-ffed-4453-8f24-145acd9a76d6)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Creating volume e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:06 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:40:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:06 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 1073741824 Sep 28 21:40:06 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:07 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 1073741824" returned: 0 in 0.581s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:07 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 Sep 28 21:40:07 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:07 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:07 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Flow 'volume_create_manager' (59726934-10d1-46c4-bde7-709d00b77f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c392ce-1937-4a8a-91f3-8b87960f0812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c392ce-1937-4a8a-91f3-8b87960f0812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-872275941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63cc7a5-72ca-4980-b118-62f4e68ce741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579001011254c1c9fa19d235ca099d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:08Z,use_quota=True,user_id='90a175dbb6a64000bbf8b01dcc5b9dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01dcea78-95db-4c06-8921-4c2fd69c2577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01dcea78-95db-4c06-8921-4c2fd69c2577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d46381-de0f-45c6-9557-7d5fdb30fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d46381-de0f-45c6-9557-7d5fdb30fd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63cc7a5-72ca-4980-b118-62f4e68ce741', 'volume_name': 'volume-a63cc7a5-72ca-4980-b118-62f4e68ce741', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d4d067-6bde-4ae9-a179-f55b6bb6dd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d4d067-6bde-4ae9-a179-f55b6bb6dd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef85bb0b-7088-4b76-90d3-231dd31d0d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Volume a63cc7a5-72ca-4980-b118-62f4e68ce741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63cc7a5-72ca-4980-b118-62f4e68ce741', 'volume_size': 1} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-cdee8a06-37a8-4c3c-9f60-0b1a3f07edb5 req-87df9786-3ff0-4eb0-acd2-2e5b8f37f3ee tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:07 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0" returned: 0 in 0.279s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-872275941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63cc7a5-72ca-4980-b118-62f4e68ce741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579001011254c1c9fa19d235ca099d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:08Z,use_quota=True,user_id='90a175dbb6a64000bbf8b01dcc5b9dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Creating volume a63cc7a5-72ca-4980-b118-62f4e68ce741 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:07 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89eeadf-5037-490c-9e9f-94a3773ccc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e894ee6a-1abd-4038-8dcd-f0da667abda0', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:07 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 1073741824 Sep 28 21:40:07 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f3f5a2-8cf6-4a2b-b634-959c72d343fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Volume volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 (e894ee6a-1abd-4038-8dcd-f0da667abda0): created successfully Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f3f5a2-8cf6-4a2b-b634-959c72d343fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:07 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Flow 'volume_create_manager' (ff3a7879-4135-483b-9f20-94a56bf84175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.292s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:07 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d5436c83-98fd-40c3-8d60-d64a69651dc0 tempest-GroupSnapshotsTest-659546145 None] Created volume successfully. Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 28 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:40:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:40:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] GroupSnapshot bb235569-0711-4717-b829-ae51354ad000: creating. Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Group snapshot bb235569-0711-4717-b829-ae51354ad000: creating. {{(pid=86489) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:08 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 1073741824" returned: 0 in 0.499s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:08 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 Sep 28 21:40:08 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:08 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-cdee8a06-37a8-4c3c-9f60-0b1a3f07edb5 req-87df9786-3ff0-4eb0-acd2-2e5b8f37f3ee tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.828s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-cdee8a06-37a8-4c3c-9f60-0b1a3f07edb5 req-87df9786-3ff0-4eb0-acd2-2e5b8f37f3ee tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.343s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef85bb0b-7088-4b76-90d3-231dd31d0d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63cc7a5-72ca-4980-b118-62f4e68ce741', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc73ff1-99bb-4588-a627-829e5c26f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Creating offline snapshot 9f8da36a-1fb1-4b83-b2fc-aff79c9da94f of volume e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:40:08 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Volume volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 (a63cc7a5-72ca-4980-b118-62f4e68ce741): created successfully Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc73ff1-99bb-4588-a627-829e5c26f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Flow 'volume_create_manager' (59726934-10d1-46c4-bde7-709d00b77f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3af0b2-c27b-4c06-91d4-c9670c90bc3e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-cdee8a06-37a8-4c3c-9f60-0b1a3f07edb5 req-87df9786-3ff0-4eb0-acd2-2e5b8f37f3ee tempest-TestInstancesWithCinderVolumes-1372769237 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cec1ff6d-e6ce-4174-8773-f178ae262574', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:40:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8d50f193-852c-4d00-aee6-d4399ceee7a8 tempest-AbsoluteLimitsTests-950964001 None] Created volume successfully. Sep 28 21:40:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-cdee8a06-37a8-4c3c-9f60-0b1a3f07edb5 req-87df9786-3ff0-4eb0-acd2-2e5b8f37f3ee tempest-TestInstancesWithCinderVolumes-1372769237 None] attachment_update completed successfully. Sep 28 21:40:08 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 Sep 28 21:40:08 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:09 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0" returned: 0 in 0.420s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:09 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f 1G Sep 28 21:40:09 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:09 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f 1G" returned: 0 in 0.525s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:09 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f Sep 28 21:40:09 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Acquiring lock "cinder-a63cc7a5-72ca-4980-b118-62f4e68ce741-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:09 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" returned: 0 in 0.324s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:09 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Lock "cinder-a63cc7a5-72ca-4980-b118-62f4e68ce741-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:09 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f Sep 28 21:40:09 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Acquiring lock "cinder-quobyte-a63cc7a5-72ca-4980-b118-62f4e68ce741" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Lock "cinder-quobyte-a63cc7a5-72ca-4980-b118-62f4e68ce741" acquired by "delete_volume" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3488230-ebf1-48df-92b0-f7b79a89ac04]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:10 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 Sep 28 21:40:10 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:10 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" returned: 0 in 0.278s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:10 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.info Sep 28 21:40:10 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:10 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741" returned: 0 in 0.390s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:10 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741 Sep 28 21:40:10 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:10 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.info" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:10 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:10 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.info Sep 28 21:40:10 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:10 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a63cc7a5-72ca-4980-b118-62f4e68ce741" returned: 0 in 0.268s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Lock "cinder-quobyte-a63cc7a5-72ca-4980-b118-62f4e68ce741" released by "delete_volume" :: held 0.703s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:10 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.info" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Created reservations ['0e225013-a723-46b0-b165-4305c953a4f8', '65941101-0970-4499-b073-af6ab1795da4', 'a91ebb90-4b2b-45e2-b752-2b971a645315', '28047e6b-899b-4ad1-8f2a-0c1a14e34509'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-91b8985b-4bae-4166-9454-efe934934bf8 tempest-GroupSnapshotsTest-659546145 None] group_snapshot bb235569-0711-4717-b829-ae51354ad000: created successfully Sep 28 21:40:10 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:10 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:11 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:11 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Deleted volume successfully. Sep 28 21:40:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5f752143-1b07-4156-abd0-63b106ee360c tempest-AbsoluteLimitsTests-950964001 None] Lock "cinder-a63cc7a5-72ca-4980-b118-62f4e68ce741-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-9f8da36a-1fb1-4b83-b2fc-aff79c9da94f-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-9f8da36a-1fb1-4b83-b2fc-aff79c9da94f-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Creating volume cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 from snapshot 9f8da36a-1fb1-4b83-b2fc-aff79c9da94f {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] snapshot: 9f8da36a-1fb1-4b83-b2fc-aff79c9da94f, volume: cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[685345d9-6155-4506-be28-fb5800f11f55]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:12 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f Sep 28 21:40:12 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:12 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" returned: 0 in 0.487s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e894ee6a-1abd-4038-8dcd-f0da667abda0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f1f164-69e0-4e97-a018-5ec1dbd7f1bc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:12 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 Sep 28 21:40:12 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:13 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0" returned: 0 in 0.454s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:40:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:40:13 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:40:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:13 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 Sep 28 21:40:13 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-ecddbef1-513e-45e6-b176-c571fc650c71 req-c46a26bd-294b-4e09-b08b-8f8879ffce43 tempest-TestInstancesWithCinderVolumes-1372769237 None] Terminate volume connection completed successfully. Sep 28 21:40:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-ecddbef1-513e-45e6-b176-c571fc650c71 req-c46a26bd-294b-4e09-b08b-8f8879ffce43 tempest-TestInstancesWithCinderVolumes-1372769237 None] Deleting attachment 9d9183ea-8f4c-4e68-ac25-4c2cd96bf7cc. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:40:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "cinder-67500b11-77fb-4285-b7f5-5af050e6dc79-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-67500b11-77fb-4285-b7f5-5af050e6dc79-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "cinder-quobyte-67500b11-77fb-4285-b7f5-5af050e6dc79" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-quobyte-67500b11-77fb-4285-b7f5-5af050e6dc79" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:18 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5a117c-84b8-4145-b530-64731af04ca1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:18 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 Sep 28 21:40:18 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:18 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79" returned: 0 in 0.921s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:19 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79 Sep 28 21:40:19 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-3b9179f2-ba54-4a1c-832d-d59e12d6bcc8 req-08c5d69d-c828-4612-830e-99b09bf3f4ba tempest-AttachVolumeTestJSON-1772433899 None] Terminate volume connection completed successfully. Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-3b9179f2-ba54-4a1c-832d-d59e12d6bcc8 req-08c5d69d-c828-4612-830e-99b09bf3f4ba tempest-AttachVolumeTestJSON-1772433899 None] Deleting attachment d44b1a96-5cf7-4841-8c1a-7e6b088d2036. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:40:19 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-67500b11-77fb-4285-b7f5-5af050e6dc79" returned: 0 in 0.693s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-quobyte-67500b11-77fb-4285-b7f5-5af050e6dc79" released by "delete_volume" :: held 1.728s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Flow 'volume_create_manager' (42eee359-8982-43c0-8aac-d45d0ffa6823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0142d12d-ebbc-47cb-be78-318040cffe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0142d12d-ebbc-47cb-be78-318040cffe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1220528943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d1ac79-2306-41bf-bf7b-db2908a10a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c68433fa3c4f0dab2336ba7fec7ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:20Z,use_quota=True,user_id='0585fbb521104359bdb36944859f205e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0304e16-4e9b-45cb-923d-bb8aeb857a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0304e16-4e9b-45cb-923d-bb8aeb857a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2e9829-b168-4fcf-ad6f-df1a91092875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2e9829-b168-4fcf-ad6f-df1a91092875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d1ac79-2306-41bf-bf7b-db2908a10a20', 'volume_name': 'volume-83d1ac79-2306-41bf-bf7b-db2908a10a20', 'volume_size': 2}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fd6e54-4a4f-43d5-82ee-bbb301af3a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fd6e54-4a4f-43d5-82ee-bbb301af3a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bde3b1-5432-4257-8158-f94525370134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:19 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Volume 83d1ac79-2306-41bf-bf7b-db2908a10a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d1ac79-2306-41bf-bf7b-db2908a10a20', 'volume_size': 2} Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:19 devstack cinder-volume[86489]: WARNING cinder.quota [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-904542288-1150574481 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-904542288-1150574481, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:19 devstack cinder-volume[86489]: WARNING cinder.quota [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-904542288-1150574481 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-904542288-1150574481, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:19 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Created reservations ['a7c109f1-b122-42b7-89e2-f6c44140e947', 'cfac8566-3a68-49e1-9135-a907613f2fb4', '765e44f4-4118-4ef0-9c3c-bcb93374cf17', 'd21999f4-2a30-4132-8284-d0d3c5518d46'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:20 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:20 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:20 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.615s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:20 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Deleted volume successfully. Sep 28 21:40:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ea80cf06-8e32-4e56-aa0b-f5397b881488 tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-67500b11-77fb-4285-b7f5-5af050e6dc79-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:22 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" returned: 0 in 9.009s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0, size 1024.00 MB, duration 9.01 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:40:22 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Converted 1024.00 MB image at 113.65 MB/s Sep 28 21:40:22 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:22 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 Sep 28 21:40:22 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:22 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" returned: 0 in 0.246s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" released by "_copy_volume_from_snapshot" :: held 10.310s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-9f8da36a-1fb1-4b83-b2fc-aff79c9da94f-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" released by "_create_volume_from_snapshot" :: held 10.380s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.401s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.651s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1220528943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d1ac79-2306-41bf-bf7b-db2908a10a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c68433fa3c4f0dab2336ba7fec7ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:20Z,use_quota=True,user_id='0585fbb521104359bdb36944859f205e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Creating volume 83d1ac79-2306-41bf-bf7b-db2908a10a20 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:22 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:40:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 2147483648 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:22 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 2147483648 Sep 28 21:40:22 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:22 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ec305654-e0c2-4492-af0e-4cfc6bc80bc4 tempest-GroupSnapshotsTest-659546145 None] Create group from source-snapshot-bb235569-0711-4717-b829-ae51354ad000 completed successfully. Sep 28 21:40:23 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 2147483648" returned: 0 in 0.731s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:23 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 Sep 28 21:40:23 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfdee15-c20d-4c76-8060-2f9c43eb87b9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:23 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20" returned: 0 in 0.326s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bde3b1-5432-4257-8158-f94525370134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d1ac79-2306-41bf-bf7b-db2908a10a20', 'volume_size': 2}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632d6543-9df7-45cf-9548-88a3207dfb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:23 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 Sep 28 21:40:23 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-8df892e1-614a-4e80-adc2-6de60afee8ab req-5b9956d4-222d-443c-9171-31b78c66469a tempest-TestInstancesWithCinderVolumes-1372769237 None] Terminate volume connection completed successfully. Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-8df892e1-614a-4e80-adc2-6de60afee8ab req-5b9956d4-222d-443c-9171-31b78c66469a tempest-TestInstancesWithCinderVolumes-1372769237 None] Deleting attachment cec1ff6d-e6ce-4174-8773-f178ae262574. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:40:23 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Volume volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 (83d1ac79-2306-41bf-bf7b-db2908a10a20): created successfully Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632d6543-9df7-45cf-9548-88a3207dfb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Flow 'volume_create_manager' (42eee359-8982-43c0-8aac-d45d0ffa6823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-90df32e5-4195-4ddf-acfe-2d7972bb6caf tempest-VolumesCloneNegativeTest-1265955246 None] Created volume successfully. Sep 28 21:40:24 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" returned: 0 in 0.472s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:24 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9 Sep 28 21:40:24 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "cinder-f3c3b140-8863-4ed8-b9d0-faed905f4fc3-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-f3c3b140-8863-4ed8-b9d0-faed905f4fc3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "cinder-quobyte-f3c3b140-8863-4ed8-b9d0-faed905f4fc3" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:24 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-quobyte-f3c3b140-8863-4ed8-b9d0-faed905f4fc3" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" returned: 0 in 0.552s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-cdca4c2d-90aa-4b3b-85e2-bc2d5dcec4f9" released by "delete_volume" :: held 1.104s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434818a-673b-4383-92c5-8608d4614f1c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Acquiring lock "cinder-83d1ac79-2306-41bf-bf7b-db2908a10a20-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Lock "cinder-83d1ac79-2306-41bf-bf7b-db2908a10a20-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Acquiring lock "cinder-quobyte-83d1ac79-2306-41bf-bf7b-db2908a10a20" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['fdf67bef-e788-48a3-b55f-0c7fda5d3130'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Lock "cinder-quobyte-83d1ac79-2306-41bf-bf7b-db2908a10a20" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:24 devstack cinder-volume[86489]: WARNING cinder.quota [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1762459877 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1762459877, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:24 devstack cinder-volume[86489]: WARNING cinder.quota [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1762459877 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1762459877, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c26cd-42f3-48b5-b5ee-a17a917a81b0]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:24 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 Sep 28 21:40:24 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:24 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['635ae97c-a4a1-4cb2-94f5-dcf8ad0006bf', '519b79f3-2c03-4edc-9bbd-3ac0cbf8480f', '2d261ede-39c3-4d17-82cb-964dea43f29f', '44f02456-2283-4c34-86b0-071120bd73ef'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:25 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 Sep 28 21:40:25 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:25 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:25 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:25 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20" returned: 0 in 0.511s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:25 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20 Sep 28 21:40:25 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:25 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3" returned: 0 in 0.874s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:25 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3 Sep 28 21:40:25 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:25 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.528s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:25 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c66d8f4d-8901-4f9a-9eb1-cebf8315d071 tempest-GroupSnapshotsTest-659546145 None] Delete group completed successfully. Sep 28 21:40:25 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83d1ac79-2306-41bf-bf7b-db2908a10a20" returned: 0 in 0.463s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Lock "cinder-quobyte-83d1ac79-2306-41bf-bf7b-db2908a10a20" released by "delete_volume" :: held 1.070s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:25 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Created reservations ['ac5b999f-c165-46ef-bf74-01961688fd16', '0924aa04-9bef-40f3-8b0e-9804bee7afc1', '33b2a543-8417-48f4-b08e-fb731ebbe6f5', 'c89dea04-38d1-4f73-ba83-dc9421c89521'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:26 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f3c3b140-8863-4ed8-b9d0-faed905f4fc3" returned: 0 in 0.608s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:26 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:26 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-quobyte-f3c3b140-8863-4ed8-b9d0-faed905f4fc3" released by "delete_volume" :: held 1.576s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:26 devstack cinder-volume[86489]: WARNING cinder.quota [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-45144633-1726290519 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-45144633-1726290519, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:26 devstack cinder-volume[86489]: WARNING cinder.quota [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-45144633-1726290519 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-45144633-1726290519, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Created reservations ['ecb23555-eaaa-421d-aa4b-3062830796d3', '02db23fc-cc9e-4086-aedb-8e1709836fc3', 'dd3b3349-e184-4760-a32d-2a9d09f11a59', '518e8672-978e-46a0-9a98-5f687a05a51c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:26 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] group_snapshot bb235569-0711-4717-b829-ae51354ad000: deleting Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] group_snapshot bb235569-0711-4717-b829-ae51354ad000: deleting {{(pid=86489) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-e894ee6a-1abd-4038-8dcd-f0da667abda0" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-e894ee6a-1abd-4038-8dcd-f0da667abda0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" acquired by "_delete_snapshot" :: waited 0.128s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:26 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:26 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Deleting offline snapshot 9f8da36a-1fb1-4b83-b2fc-aff79c9da94f of volume e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:40:26 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] snapshot_file for this snap is: volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.589s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:26 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Deleted volume successfully. Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc56589-0037-4bcb-8687-022ac5e96df5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b5cf33f-30f5-4a23-a322-0b0f1ba0cb4a tempest-VolumesCloneNegativeTest-1265955246 None] Lock "cinder-83d1ac79-2306-41bf-bf7b-db2908a10a20-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:26 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f Sep 28 21:40:26 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:27 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.571s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:27 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Deleted volume successfully. Sep 28 21:40:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8c561942-0574-472d-98be-fc7b25d85d1e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-f3c3b140-8863-4ed8-b9d0-faed905f4fc3-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:27 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" returned: 0 in 0.639s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e894ee6a-1abd-4038-8dcd-f0da667abda0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:40:27 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6538e656-fc88-4477-bd11-462cd0b142ec]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:27 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 Sep 28 21:40:27 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:28 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0" returned: 0 in 0.825s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:28 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f Sep 28 21:40:28 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:28 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" returned: 0 in 0.602s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:28 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f Sep 28 21:40:28 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:29 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0.9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" returned: 0 in 0.499s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-9f8da36a-1fb1-4b83-b2fc-aff79c9da94f" released by "_delete_snapshot" :: held 2.778s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-e894ee6a-1abd-4038-8dcd-f0da667abda0" released by "delete_snapshot" :: held 2.926s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:29 devstack cinder-volume[86489]: WARNING cinder.quota [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1762459877 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1762459877, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:29 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['9950c0eb-3bc6-451f-9b83-d13b3ebe667b', '40828e63-2bf0-4c14-8c79-c9bfa72a1c50', 'a22649f0-2d5d-49ad-b411-da64015b6bc7', 'c67acfbd-6c6a-4bdc-9ea9-19c56fc8efb8'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2f64843b-c226-4ba3-91df-d6098121b3a8 tempest-GroupSnapshotsTest-659546145 None] group_snapshot bb235569-0711-4717-b829-ae51354ad000: deleted successfully Sep 28 21:40:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-e894ee6a-1abd-4038-8dcd-f0da667abda0" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-e894ee6a-1abd-4038-8dcd-f0da667abda0" acquired by "delete_volume" :: waited 0.042s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:31 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7b4f72-2560-42e8-b430-10779badcc77]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:31 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 Sep 28 21:40:31 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:31 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0" returned: 0 in 0.542s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:31 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0 Sep 28 21:40:31 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-9c3d6a4a-a89c-417f-b314-7b1af84956e8 req-f1b29e0c-7f5a-4811-8904-85320678ddf8 tempest-TestInstancesWithCinderVolumes-1372769237 None] Terminate volume connection completed successfully. Sep 28 21:40:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-9c3d6a4a-a89c-417f-b314-7b1af84956e8 req-f1b29e0c-7f5a-4811-8904-85320678ddf8 tempest-TestInstancesWithCinderVolumes-1372769237 None] Deleting attachment b8b6c3e9-e5e1-47cc-a095-1f4a2712b7cc. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:40:32 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e894ee6a-1abd-4038-8dcd-f0da667abda0" returned: 0 in 0.522s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-e894ee6a-1abd-4038-8dcd-f0da667abda0" released by "delete_volume" :: held 1.267s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['24eab77b-ae99-4967-9b2c-5249aa9ebb1d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:32 devstack cinder-volume[86489]: WARNING cinder.db.api [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1762459877'] Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['94ec9c59-2e74-41d7-b93b-9f11c3616eea', '704d1b2b-dd4b-4e21-a1a8-40a8c4b5ab2b', 'b77fb597-f447-40c4-8d67-86e1d14011ca', '0a3b1a2d-165b-4a01-b219-d20e73e10ead'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:32 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:32 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:32 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.301s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:32 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ce2b541d-9691-4d0b-a6c8-94c051bb3030 tempest-GroupSnapshotsTest-659546145 None] Delete group completed successfully. Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (301ff806-ff62-4367-bb46-b1d732ae6629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0e3fac-2304-4be2-85d4-7ea91215dea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "cinder-83349bbf-871e-4750-91ae-e83a564e3665-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0e3fac-2304-4be2-85d4-7ea91215dea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-678729348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c05b97-0654-4f96-8efc-0eb8eaa36f3a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:34Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd54914-5c87-4a3e-acec-6298803aff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd54914-5c87-4a3e-acec-6298803aff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a381919-0d19-4b9d-9257-e6bc63a40e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a381919-0d19-4b9d-9257-e6bc63a40e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c05b97-0654-4f96-8efc-0eb8eaa36f3a', 'volume_name': 'volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe903c9c-b321-4ab6-99e5-bbd8fc1cf593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe903c9c-b321-4ab6-99e5-bbd8fc1cf593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650309d5-28aa-4626-822a-93cd011f480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Volume c3c05b97-0654-4f96-8efc-0eb8eaa36f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a', 'volume_size': 1} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-678729348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c05b97-0654-4f96-8efc-0eb8eaa36f3a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:34Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Creating volume c3c05b97-0654-4f96-8efc-0eb8eaa36f3a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:33 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-83349bbf-871e-4750-91ae-e83a564e3665-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:33 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a 1073741824 Sep 28 21:40:33 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "cinder-quobyte-83349bbf-871e-4750-91ae-e83a564e3665" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-quobyte-83349bbf-871e-4750-91ae-e83a564e3665" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9cbf19-ecb5-4655-b842-4040a405b24e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7623f072-02ee-4d56-b256-1934824d729d tempest-GroupSnapshotsTest-659546145 None] Group tempest-GroupSnapshotsTest-Group-1719130142: creating Sep 28 21:40:34 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 Sep 28 21:40:34 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7623f072-02ee-4d56-b256-1934824d729d tempest-GroupSnapshotsTest-659546145 None] Group tempest-GroupSnapshotsTest-Group-1719130142: created successfully Sep 28 21:40:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7623f072-02ee-4d56-b256-1934824d729d tempest-GroupSnapshotsTest-659546145 None] Create group completed successfully. Sep 28 21:40:34 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a 1073741824" returned: 0 in 0.537s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:34 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a Sep 28 21:40:34 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:34 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665" returned: 0 in 0.490s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:34 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665 Sep 28 21:40:34 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:34 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a" returned: 0 in 0.267s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650309d5-28aa-4626-822a-93cd011f480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf23ca2-aa7d-46d8-8d85-1b41d15e0c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:34 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Volume volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a (c3c05b97-0654-4f96-8efc-0eb8eaa36f3a): created successfully Sep 28 21:40:34 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf23ca2-aa7d-46d8-8d85-1b41d15e0c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (301ff806-ff62-4367-bb46-b1d732ae6629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-83349bbf-871e-4750-91ae-e83a564e3665" returned: 0 in 0.271s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-quobyte-83349bbf-871e-4750-91ae-e83a564e3665" released by "delete_volume" :: held 0.834s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-930a6c29-8a2d-44ea-a088-d3d351fcd5e1 tempest-VolumesGetTest-1878182973 None] Created volume successfully. Sep 28 21:40:34 devstack cinder-volume[86489]: WARNING cinder.quota [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-64733244-1320747085 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-64733244-1320747085, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:34 devstack cinder-volume[86489]: WARNING cinder.quota [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-64733244-1320747085 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-64733244-1320747085, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Created reservations ['0a6bde88-b8d8-43da-9005-fbad3f3125f1', '781265a3-8fb9-4394-b285-b1ef7788b6f4', '059c1187-bdab-46be-992a-d9b2e7bb16df', '93c93c80-3c70-4bfe-b8ee-e7684fd6d35e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:34 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:34 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:35 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.293s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:35 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Deleted volume successfully. Sep 28 21:40:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-58d254ad-9d97-4860-a1e9-cc8fc8c92c9e tempest-TestInstancesWithCinderVolumes-1372769237 None] Lock "cinder-83349bbf-871e-4750-91ae-e83a564e3665-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:35 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Flow 'volume_create_manager' (a9d5e782-713b-43c4-b076-a9bc3dd00f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60db0fbf-c062-4373-a5c2-d5b0e7fe8eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60db0fbf-c062-4373-a5c2-d5b0e7fe8eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-989289338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b420cc9-2a75-43f7-99cd-9b4e2c91aa08,host='devstack@QuobyteHD#QuobyteHD',id=892121d9-0f58-4488-8e3f-0b291171b765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29be7e6d59684794ac8a4a20e43c239d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:36Z,use_quota=True,user_id='ad6137ec18b143f796e74a58c2f9f167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db1b85c3-2ee5-4898-b2b2-5798e2cdd183),volume_type_id=db1b85c3-2ee5-4898-b2b2-5798e2cdd183)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c2c56-9dff-4862-85b8-7b72128a0261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c2c56-9dff-4862-85b8-7b72128a0261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30c63d6-c2de-4b03-b3fe-8a2e5c3cbea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30c63d6-c2de-4b03-b3fe-8a2e5c3cbea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892121d9-0f58-4488-8e3f-0b291171b765', 'volume_name': 'volume-892121d9-0f58-4488-8e3f-0b291171b765', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ab8164-6474-4a41-b8d5-1d40553a2f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ab8164-6474-4a41-b8d5-1d40553a2f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a260c8ed-1788-478a-93ce-94960fde73e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:36 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Volume 892121d9-0f58-4488-8e3f-0b291171b765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892121d9-0f58-4488-8e3f-0b291171b765', 'volume_size': 1} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b420cc9-2a75-43f7-99cd-9b4e2c91aa08,created_at=2026-09-28T19:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-989289338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b420cc9-2a75-43f7-99cd-9b4e2c91aa08,host='devstack@QuobyteHD#QuobyteHD',id=892121d9-0f58-4488-8e3f-0b291171b765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29be7e6d59684794ac8a4a20e43c239d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:36Z,use_quota=True,user_id='ad6137ec18b143f796e74a58c2f9f167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db1b85c3-2ee5-4898-b2b2-5798e2cdd183),volume_type_id=db1b85c3-2ee5-4898-b2b2-5798e2cdd183)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Creating volume 892121d9-0f58-4488-8e3f-0b291171b765 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:36 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:36 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 1073741824 Sep 28 21:40:36 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:36 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 1073741824" returned: 0 in 0.585s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:36 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 Sep 28 21:40:36 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:37 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765" returned: 0 in 0.458s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a260c8ed-1788-478a-93ce-94960fde73e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892121d9-0f58-4488-8e3f-0b291171b765', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35be5fe-05dd-4879-bad1-bdacfacde05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:37 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Volume volume-892121d9-0f58-4488-8e3f-0b291171b765 (892121d9-0f58-4488-8e3f-0b291171b765): created successfully Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35be5fe-05dd-4879-bad1-bdacfacde05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Flow 'volume_create_manager' (a9d5e782-713b-43c4-b076-a9bc3dd00f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-dd8dbd89-1b0a-43f9-9356-509918fa5bdc tempest-GroupSnapshotsTest-659546145 None] Created volume successfully. Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (98e2d401-634a-4e6b-b7da-65ccc0d4af98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1467c35-7218-4351-aca6-731088960d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1467c35-7218-4351-aca6-731088960d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-319450480',display_name='tempest-VolumesGetTest-Volume-693596492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22867af1-dafa-4d06-8d7f-e9726415611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:37Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e3571a-a3bc-45cd-a1b9-d6fc0bb849e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e3571a-a3bc-45cd-a1b9-d6fc0bb849e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3368ef62-d135-4582-8e34-27ca89154d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3368ef62-d135-4582-8e34-27ca89154d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22867af1-dafa-4d06-8d7f-e9726415611c', 'volume_name': 'volume-22867af1-dafa-4d06-8d7f-e9726415611c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7c3fb8-3215-4315-a4ba-4a38eb8f0b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7c3fb8-3215-4315-a4ba-4a38eb8f0b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1006e24c-cbf1-46a9-988d-3bd60bc954e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:37 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Volume 22867af1-dafa-4d06-8d7f-e9726415611c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22867af1-dafa-4d06-8d7f-e9726415611c', 'volume_size': 1} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-319450480',display_name='tempest-VolumesGetTest-Volume-693596492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22867af1-dafa-4d06-8d7f-e9726415611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:37Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Creating volume 22867af1-dafa-4d06-8d7f-e9726415611c {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:37 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:40:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:37 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c 1073741824 Sep 28 21:40:37 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:37 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c 1073741824" returned: 0 in 0.540s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:38 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c Sep 28 21:40:38 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:38 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c" returned: 0 in 0.272s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=113,cinder:SELECT=119,cinder:INSERT=32,cinder:DELETE=6 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=109,cinder:UPDATE=121,cinder:DELETE=8,cinder:INSERT=33 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1006e24c-cbf1-46a9-988d-3bd60bc954e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22867af1-dafa-4d06-8d7f-e9726415611c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caff15a7-acf7-49d7-852b-431275c5187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:38 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Volume volume-22867af1-dafa-4d06-8d7f-e9726415611c (22867af1-dafa-4d06-8d7f-e9726415611c): created successfully Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caff15a7-acf7-49d7-852b-431275c5187b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (98e2d401-634a-4e6b-b7da-65ccc0d4af98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Flow 'volume_create_manager' (4002cf43-8686-4eed-b8d2-cf90e5082692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3588792-25b5-4d22-96e5-a510f6aef77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-80819be8-fe3d-4f6f-b0ae-646a494fc606 tempest-VolumesGetTest-1878182973 None] Created volume successfully. Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3588792-25b5-4d22-96e5-a510f6aef77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-474856781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b420cc9-2a75-43f7-99cd-9b4e2c91aa08,host='devstack@QuobyteHD#QuobyteHD',id=d48cd6d3-62aa-4992-8fa7-a018a55ca6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29be7e6d59684794ac8a4a20e43c239d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:38Z,use_quota=True,user_id='ad6137ec18b143f796e74a58c2f9f167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db1b85c3-2ee5-4898-b2b2-5798e2cdd183),volume_type_id=db1b85c3-2ee5-4898-b2b2-5798e2cdd183)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76942d6-dc0b-45f4-a307-6375281f0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76942d6-dc0b-45f4-a307-6375281f0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38c3108-47a8-44e3-8e5f-2204019af791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38c3108-47a8-44e3-8e5f-2204019af791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48cd6d3-62aa-4992-8fa7-a018a55ca6e8', 'volume_name': 'volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aac104-b968-40ff-9c91-80ee98124588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aac104-b968-40ff-9c91-80ee98124588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79609f0b-cb89-4977-8919-201a6c62d636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:38 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Volume d48cd6d3-62aa-4992-8fa7-a018a55ca6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8', 'volume_size': 1} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b420cc9-2a75-43f7-99cd-9b4e2c91aa08,created_at=2026-09-28T19:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-474856781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b420cc9-2a75-43f7-99cd-9b4e2c91aa08,host='devstack@QuobyteHD#QuobyteHD',id=d48cd6d3-62aa-4992-8fa7-a018a55ca6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29be7e6d59684794ac8a4a20e43c239d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:38Z,use_quota=True,user_id='ad6137ec18b143f796e74a58c2f9f167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db1b85c3-2ee5-4898-b2b2-5798e2cdd183),volume_type_id=db1b85c3-2ee5-4898-b2b2-5798e2cdd183)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Creating volume d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:38 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:40:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:38 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 1073741824 Sep 28 21:40:38 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:39 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 1073741824" returned: 0 in 0.497s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:39 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 Sep 28 21:40:39 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:39 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" returned: 0 in 0.291s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79609f0b-cb89-4977-8919-201a6c62d636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98114bf-12eb-4b85-8468-f8c5d7082f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:39 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Volume volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 (d48cd6d3-62aa-4992-8fa7-a018a55ca6e8): created successfully Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98114bf-12eb-4b85-8468-f8c5d7082f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Flow 'volume_create_manager' (4002cf43-8686-4eed-b8d2-cf90e5082692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-93e2a6a4-da53-49b5-bd73-c48546ad3222 tempest-GroupSnapshotsTest-659546145 None] Created volume successfully. Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-22867af1-dafa-4d06-8d7f-e9726415611c-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Lock "cinder-22867af1-dafa-4d06-8d7f-e9726415611c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-22867af1-dafa-4d06-8d7f-e9726415611c" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-22867af1-dafa-4d06-8d7f-e9726415611c" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f654c483-b9bc-4d7f-8de4-af53554e05d5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:39 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c Sep 28 21:40:39 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b1a43d72-d40a-45cb-9553-f4422b7d760a tempest-GroupSnapshotsTest-659546145 None] Update group completed successfully. Sep 28 21:40:40 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c" returned: 0 in 0.379s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:40 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c Sep 28 21:40:40 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:40 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-22867af1-dafa-4d06-8d7f-e9726415611c" returned: 0 in 0.269s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-22867af1-dafa-4d06-8d7f-e9726415611c" released by "delete_volume" :: held 0.707s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Created reservations ['5518fb3f-6ef8-4ce3-80f9-d9d1eaee8328', '9d6b4ed4-f7ac-4a8b-98ec-6eb2ec6a5892', 'be3ebfbd-d79c-4f02-be30-9f8c4054ca4a', '83803582-07a3-4bf8-b6ed-5ecb4ab49d6b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:40 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:40 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:40 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.352s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:40 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Deleted volume successfully. Sep 28 21:40:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e9a5ea11-236d-4a90-84b6-00ef9d82a382 tempest-VolumesGetTest-1878182973 None] Lock "cinder-22867af1-dafa-4d06-8d7f-e9726415611c-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Lock "cinder-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[35252f7e-e3b5-4b1f-8743-08eaba829246]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:41 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f6c089a5-a339-4381-aa9e-36653a2f8597 tempest-GroupSnapshotsTest-659546145 None] Update group completed successfully. Sep 28 21:40:41 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a Sep 28 21:40:41 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:41 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a" returned: 0 in 0.393s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:41 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a Sep 28 21:40:41 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:41 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a" returned: 0 in 0.303s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a" released by "delete_volume" :: held 0.752s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Created reservations ['2e0ce297-f438-4453-8443-7fc4239ce0f3', '7136045c-27be-48d5-b097-eaf7fbb16483', 'c39ef3b0-634d-4eeb-9f04-337f1750b66e', 'e0f86ce8-8492-4a79-a0b8-c1f8bf83e424'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:42 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:40:42 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:42 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.301s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:40:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Deleted volume successfully. Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6f5d115e-d1b2-4379-a0ab-33878ead46d9 tempest-VolumesGetTest-1878182973 None] Lock "cinder-c3c05b97-0654-4f96-8efc-0eb8eaa36f3a-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a991990a-e915-46d0-af6d-1dca98bcdcd0 tempest-GroupSnapshotsTest-659546145 None] Update group completed successfully. Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (22dfcedb-0883-40e2-ac83-63d9bc5c8ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d425f6d1-fdb4-4543-b2d1-38e01b74fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d425f6d1-fdb4-4543-b2d1-38e01b74fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1050802780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4cb80c-db6c-4faf-8615-eb9992c488b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:43Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc8dcae-2138-4eff-a75d-8461359e5bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc8dcae-2138-4eff-a75d-8461359e5bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8660c5dc-5438-4bae-8d0d-7e4b433e5f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8660c5dc-5438-4bae-8d0d-7e4b433e5f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4cb80c-db6c-4faf-8615-eb9992c488b7', 'volume_name': 'volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229c37d3-6382-4da8-a910-5ee5c835249b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229c37d3-6382-4da8-a910-5ee5c835249b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1a469c-ecb2-41b2-8a06-fc861259d29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:42 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Volume fb4cb80c-db6c-4faf-8615-eb9992c488b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7', 'volume_size': 1} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1050802780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4cb80c-db6c-4faf-8615-eb9992c488b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:43Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Creating volume fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:40:42 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:40:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:42 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 1073741824 Sep 28 21:40:42 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:43 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 1073741824" returned: 0 in 0.469s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:43 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 Sep 28 21:40:43 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:43 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c5f277f1-b6f4-44bc-9b5e-b2353bdea032 tempest-GroupSnapshotsTest-659546145 None] Update group completed successfully. Sep 28 21:40:43 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7" returned: 0 in 0.262s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1a469c-ecb2-41b2-8a06-fc861259d29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a98eb6e-3275-40c9-8e0e-e5573e12a765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:43 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Volume volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 (fb4cb80c-db6c-4faf-8615-eb9992c488b7): created successfully Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a98eb6e-3275-40c9-8e0e-e5573e12a765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (22dfcedb-0883-40e2-ac83-63d9bc5c8ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:43 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-52ecf77e-530e-4315-a237-83ded05c9b98 tempest-VolumesGetTest-1878182973 None] Created volume successfully. Sep 28 21:40:45 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] GroupSnapshot 915b8580-6d2f-4830-bdc8-f6c3cc56a7ef: creating. Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Group snapshot 915b8580-6d2f-4830-bdc8-f6c3cc56a7ef: creating. {{(pid=86489) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Creating offline snapshot 413c2b69-3211-48a9-8632-17495e4fb9fb of volume 892121d9-0f58-4488-8e3f-0b291171b765 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79e6aea-1598-460f-ade6-91922d27b57d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:45 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 Sep 28 21:40:45 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (7860c2f4-38cd-44bd-b27e-c731e68928c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1269729d-8e4d-402f-b75e-32ad0560d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1269729d-8e4d-402f-b75e-32ad0560d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-131770586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3772454-f844-487a-bc7a-59305fb92c27,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fb4cb80c-db6c-4faf-8615-eb9992c488b7,status='creating',terminated_at=None,updated_at=2026-09-28T19:40:45Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f9a37-aef3-4750-a5fd-a94a9671a349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f9a37-aef3-4750-a5fd-a94a9671a349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21995196-36ab-45f1-a454-73457e696b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21995196-36ab-45f1-a454-73457e696b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e3772454-f844-487a-bc7a-59305fb92c27', 'volume_name': 'volume-e3772454-f844-487a-bc7a-59305fb92c27', 'volume_size': 1, 'source_volid': 'fb4cb80c-db6c-4faf-8615-eb9992c488b7', 'source_volstatus': 'available'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97152c0f-3739-4b40-b53a-3711ca3db648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97152c0f-3739-4b40-b53a-3711ca3db648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d1c423-4206-43a8-89b8-ce0777b41594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:40:45 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Volume e3772454-f844-487a-bc7a-59305fb92c27: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e3772454-f844-487a-bc7a-59305fb92c27', 'volume_size': 1, 'source_volid': 'fb4cb80c-db6c-4faf-8615-eb9992c488b7', 'source_volstatus': 'available'} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:45 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765" returned: 0 in 0.431s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:45 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb 1G Sep 28 21:40:45 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:46 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb 1G" returned: 0 in 0.438s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892121d9-0f58-4488-8e3f-0b291171b765 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:46 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892121d9-0f58-4488-8e3f-0b291171b765 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb Sep 28 21:40:46 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:46 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892121d9-0f58-4488-8e3f-0b291171b765 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb" returned: 0 in 0.338s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:46 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:40:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:46 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb Sep 28 21:40:46 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:46 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb" returned: 0 in 0.248s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:46 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.info Sep 28 21:40:46 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:46 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.info" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:46 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:40:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:46 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.info Sep 28 21:40:46 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:47 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.info" returned: 0 in 0.259s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Creating offline snapshot c1f6ba2c-9e75-4080-990f-af4a478316f5 of volume d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e90156-271e-4ce8-bf8f-9aa74e697d28]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:47 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 Sep 28 21:40:47 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:47 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" returned: 0 in 0.401s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:47 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 1G Sep 28 21:40:47 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:48 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 1G" returned: 0 in 0.536s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:48 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 Sep 28 21:40:48 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:48 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5" returned: 0 in 0.353s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:48 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:40:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:48 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 Sep 28 21:40:48 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:48 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5" returned: 0 in 0.255s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:48 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.info Sep 28 21:40:48 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:49 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.info" returned: 0 in 0.287s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:49 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:49 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.info Sep 28 21:40:49 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:49 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.info" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.883s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:49 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Cloning volume fb4cb80c-db6c-4faf-8615-eb9992c488b7 to volume e3772454-f844-487a-bc7a-59305fb92c27 Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Creating offline snapshot 08f23e10-bda2-49e1-93be-e17a9f6d30ca of volume fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64138a-00f7-456d-8e80-19d3ddb200a7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:49 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fa356650-31f3-4412-a030-6b4edd7981ea tempest-GroupSnapshotsTest-659546145 None] group_snapshot 915b8580-6d2f-4830-bdc8-f6c3cc56a7ef: created successfully Sep 28 21:40:49 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 Sep 28 21:40:49 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:49 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7" returned: 0 in 0.388s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:49 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca 1G Sep 28 21:40:49 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:50 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca 1G" returned: 0 in 0.452s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:50 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca Sep 28 21:40:50 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] group_snapshot 915b8580-6d2f-4830-bdc8-f6c3cc56a7ef: deleting Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] group_snapshot 915b8580-6d2f-4830-bdc8-f6c3cc56a7ef: deleting {{(pid=86489) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-892121d9-0f58-4488-8e3f-0b291171b765" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-892121d9-0f58-4488-8e3f-0b291171b765" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-413c2b69-3211-48a9-8632-17495e4fb9fb" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-413c2b69-3211-48a9-8632-17495e4fb9fb" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Deleting offline snapshot 413c2b69-3211-48a9-8632-17495e4fb9fb of volume 892121d9-0f58-4488-8e3f-0b291171b765 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] snapshot_file for this snap is: volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e25bb4f-f86f-4152-b8cc-032732095812]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:50 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca" returned: 0 in 0.487s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:50 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca is being set with open permissions: ugo+rw Sep 28 21:40:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:50 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca Sep 28 21:40:50 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:51 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb Sep 28 21:40:51 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:51 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca" returned: 0 in 0.439s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:51 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.info Sep 28 21:40:51 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:51 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb" returned: 0 in 0.605s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-892121d9-0f58-4488-8e3f-0b291171b765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:40:51 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c772b17c-70e7-4185-bb78-8a61b6861cbd]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:51 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 Sep 28 21:40:51 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:51 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.info" returned: 0 in 0.361s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:51 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.info is being set with open permissions: ugo+rw Sep 28 21:40:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:51 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.info Sep 28 21:40:51 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:52 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765" returned: 0 in 0.548s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:52 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb Sep 28 21:40:52 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:52 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.info" returned: 0 in 0.465s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-e3772454-f844-487a-bc7a-59305fb92c27" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-e3772454-f844-487a-bc7a-59305fb92c27" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] snapshot: 08f23e10-bda2-49e1-93be-e17a9f6d30ca, volume: e3772454-f844-487a-bc7a-59305fb92c27, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d8362e-3f1b-4126-a5f2-84b93c4c0a40]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:52 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca Sep 28 21:40:52 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:52 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb" returned: 0 in 0.498s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:52 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb Sep 28 21:40:52 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:52 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca" returned: 0 in 0.536s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfd00a6-0702-4ca5-afcd-0e93970ccb7f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:52 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765.413c2b69-3211-48a9-8632-17495e4fb9fb" returned: 0 in 0.394s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-413c2b69-3211-48a9-8632-17495e4fb9fb" released by "_delete_snapshot" :: held 2.211s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-892121d9-0f58-4488-8e3f-0b291171b765" released by "delete_snapshot" :: held 2.260s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:52 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 Sep 28 21:40:52 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-c1f6ba2c-9e75-4080-990f-af4a478316f5" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-c1f6ba2c-9e75-4080-990f-af4a478316f5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Deleting offline snapshot c1f6ba2c-9e75-4080-990f-af4a478316f5 of volume d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] snapshot_file for this snap is: volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d9b4a8-2890-4dc3-867c-e25cd33edefe]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:53 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 Sep 28 21:40:53 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:53 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7" returned: 0 in 0.435s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:53 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 Sep 28 21:40:53 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:53 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5" returned: 0 in 0.477s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedf45eb-e501-4c43-84b4-8bb44f3ee8bc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:53 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 Sep 28 21:40:53 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:54 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" returned: 0 in 0.781s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:54 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 Sep 28 21:40:54 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:55 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5" returned: 0 in 0.989s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:55 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5 Sep 28 21:40:55 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:55 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8.c1f6ba2c-9e75-4080-990f-af4a478316f5" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-c1f6ba2c-9e75-4080-990f-af4a478316f5" released by "_delete_snapshot" :: held 2.816s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" released by "delete_snapshot" :: held 2.874s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:40:56 devstack cinder-volume[86489]: WARNING cinder.quota [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1463151193 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1463151193, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:56 devstack cinder-volume[86489]: WARNING cinder.quota [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1463151193 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1463151193, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:40:56 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['2f444b3c-3a3b-44b0-8fa7-81909d7f3f59', '3000120d-a811-4e54-be99-43ca6a408512', 'a35a0134-8e83-457d-9289-afc5217c3520', '31bba944-8761-42dd-b494-6e88c61350f1'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:56 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['b26008b2-c7bd-498b-b85d-cc10ed27abaa', 'a9fd7ff9-8034-4ac5-9a12-cab7b34c3f32', 'a8fb5719-cea1-4540-9e1a-b1b35aa7e311', '1626bdcb-e69e-4042-bc72-6f5a802850e4'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:40:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c13abed5-595c-49da-9275-a28403383081 tempest-GroupSnapshotsTest-659546145 None] group_snapshot 915b8580-6d2f-4830-bdc8-f6c3cc56a7ef: deleted successfully Sep 28 21:40:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-892121d9-0f58-4488-8e3f-0b291171b765" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:40:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-892121d9-0f58-4488-8e3f-0b291171b765" acquired by "delete_volume" :: waited 0.052s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:40:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f194e2f-cd6e-4b41-9c9a-65f2bc2cfb83]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:40:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:59 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 Sep 28 21:40:59 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:40:59 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Sep 28 21:40:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765" returned: 0 in 0.662s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:40:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:40:59 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765 Sep 28 21:40:59 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:00 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-892121d9-0f58-4488-8e3f-0b291171b765" returned: 0 in 0.560s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-892121d9-0f58-4488-8e3f-0b291171b765" released by "delete_volume" :: held 1.429s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" acquired by "delete_volume" :: waited 0.045s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[771ed15e-e7d3-4c50-b34e-7d37ae916152]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:00 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 Sep 28 21:41:00 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:00 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" returned: 0 in 0.570s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:01 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8 Sep 28 21:41:01 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:01 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" returned: 0 in 0.507s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-d48cd6d3-62aa-4992-8fa7-a018a55ca6e8" released by "delete_volume" :: held 1.307s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['4cc9ef2c-7f4a-4260-990f-85bf119fa267'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:01 devstack cinder-volume[86489]: WARNING cinder.quota [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1463151193 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1463151193, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:41:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['dedcfdd7-71de-44be-988c-8717e31e70f5', '5b196a5a-a65a-477e-9299-948fd77ab378', '2e759598-f781-4af0-86fd-ae3a6f44a5e8', 'e77626ad-ea2e-4e52-99c2-6a6239d5a8ae'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['9f565f75-cd2d-4d04-b23a-6e7e12b8ed61', '76eb9d76-fafc-49f2-98cf-db0bd0b01ed7', '98faf118-91f6-44fd-8be0-4b21e5e176c9', '8a7dccb2-a0dc-4287-a4a0-6031ee7873d0'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:02 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:02 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:02 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.526s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:02 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:02 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b2223bea-a4d8-4592-a05d-29cb3b8aa1a4 tempest-GroupSnapshotsTest-659546145 None] Delete group completed successfully. Sep 28 21:41:03 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27" returned: 0 in 10.096s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7, size 1024.00 MB, duration 10.10 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:41:03 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Converted 1024.00 MB image at 101.41 MB/s Sep 28 21:41:03 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 is being set with open permissions: ugo+rw Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:03 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 Sep 28 21:41:03 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:03 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27" returned: 0 in 0.317s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-e3772454-f844-487a-bc7a-59305fb92c27" released by "_copy_volume_from_snapshot" :: held 11.512s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-08f23e10-bda2-49e1-93be-e17a9f6d30ca" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:03 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-07604bf1-7b2f-42c5-9364-d35bd3cd324c tempest-GroupSnapshotsTest-659546145 None] Group tempest-GroupSnapshotsTest-Group-878564305: creating Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-08f23e10-bda2-49e1-93be-e17a9f6d30ca" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Deleting offline snapshot 08f23e10-bda2-49e1-93be-e17a9f6d30ca of volume fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] snapshot_file for this snap is: volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[35320e99-97c6-43ff-bb98-d66662f2a315]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:03 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-07604bf1-7b2f-42c5-9364-d35bd3cd324c tempest-GroupSnapshotsTest-659546145 None] Group tempest-GroupSnapshotsTest-Group-878564305: created successfully Sep 28 21:41:03 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-07604bf1-7b2f-42c5-9364-d35bd3cd324c tempest-GroupSnapshotsTest-659546145 None] Create group completed successfully. Sep 28 21:41:04 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca Sep 28 21:41:04 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:04 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca" returned: 0 in 0.479s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:41:04 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b1bb24-eddf-4b37-999b-420bb295c6e9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:04 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 Sep 28 21:41:04 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:05 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7" returned: 0 in 0.609s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:05 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca Sep 28 21:41:05 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:05 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca" returned: 0 in 0.510s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:05 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca Sep 28 21:41:05 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Flow 'volume_create_manager' (f88de03d-30dd-49c6-b673-3609953180e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3f2aaa-de45-410f-b47c-3b75e1cedeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3f2aaa-de45-410f-b47c-3b75e1cedeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2041257220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=075abf7c-7e88-416c-b948-be5fb1b20542,host='devstack@QuobyteHD#QuobyteHD',id=9e8efe66-669e-4c5e-a4f9-6de314701e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29be7e6d59684794ac8a4a20e43c239d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:06Z,use_quota=True,user_id='ad6137ec18b143f796e74a58c2f9f167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25fee76a-830d-4cb0-a22b-e07f01cfad5d),volume_type_id=25fee76a-830d-4cb0-a22b-e07f01cfad5d)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d11eeb-723a-4837-a907-6455b0810abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d11eeb-723a-4837-a907-6455b0810abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d88331-b092-44dc-a22e-2055295fb1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d88331-b092-44dc-a22e-2055295fb1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8efe66-669e-4c5e-a4f9-6de314701e51', 'volume_name': 'volume-9e8efe66-669e-4c5e-a4f9-6de314701e51', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4369741b-fd58-435e-87ab-e9a70391fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4369741b-fd58-435e-87ab-e9a70391fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7496ecc3-0244-41e3-aaf2-9b6ee8dae41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:05 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Volume 9e8efe66-669e-4c5e-a4f9-6de314701e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8efe66-669e-4c5e-a4f9-6de314701e51', 'volume_size': 1} Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:05 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7.08f23e10-bda2-49e1-93be-e17a9f6d30ca" returned: 0 in 0.445s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-08f23e10-bda2-49e1-93be-e17a9f6d30ca" released by "_delete_snapshot" :: held 2.170s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.603s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=075abf7c-7e88-416c-b948-be5fb1b20542,created_at=2026-09-28T19:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2041257220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=075abf7c-7e88-416c-b948-be5fb1b20542,host='devstack@QuobyteHD#QuobyteHD',id=9e8efe66-669e-4c5e-a4f9-6de314701e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29be7e6d59684794ac8a4a20e43c239d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:06Z,use_quota=True,user_id='ad6137ec18b143f796e74a58c2f9f167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25fee76a-830d-4cb0-a22b-e07f01cfad5d),volume_type_id=25fee76a-830d-4cb0-a22b-e07f01cfad5d)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Creating volume 9e8efe66-669e-4c5e-a4f9-6de314701e51 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:06 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:06 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 1073741824 Sep 28 21:41:06 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d1c423-4206-43a8-89b8-ce0777b41594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3772454-f844-487a-bc7a-59305fb92c27', 'volume_size': 1, 'source_volid': 'fb4cb80c-db6c-4faf-8615-eb9992c488b7', 'source_volstatus': 'available'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20afc039-31a0-4c29-bd87-7e9745c5ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:06 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Volume volume-e3772454-f844-487a-bc7a-59305fb92c27 (e3772454-f844-487a-bc7a-59305fb92c27): created successfully Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20afc039-31a0-4c29-bd87-7e9745c5ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (7860c2f4-38cd-44bd-b27e-c731e68928c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ba6231f5-c993-4c32-bee9-195d4b5a82b1 tempest-VolumesGetTest-1878182973 None] Created volume successfully. Sep 28 21:41:06 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 1073741824" returned: 0 in 0.607s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:06 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 Sep 28 21:41:06 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:07 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51" returned: 0 in 0.389s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7496ecc3-0244-41e3-aaf2-9b6ee8dae41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8efe66-669e-4c5e-a4f9-6de314701e51', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5525de13-15a5-4ea7-a6f9-2fac4b15ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Volume volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 (9e8efe66-669e-4c5e-a4f9-6de314701e51): created successfully Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5525de13-15a5-4ea7-a6f9-2fac4b15ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Flow 'volume_create_manager' (f88de03d-30dd-49c6-b673-3609953180e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:07 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-08afe969-b667-4565-8695-a15168a20e2e tempest-GroupSnapshotsTest-659546145 None] Created volume successfully. Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:07 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:07 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:07 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.320s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (de8458b7-edae-4d4a-9d94-b3e050e46d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8690d2c-87da-43e5-925c-4db01e635cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 28 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8690d2c-87da-43e5-925c-4db01e635cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-644408861',display_name='tempest-VolumesGetTest-Volume-38381485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0420c02-370c-47dc-8015-85a4136983e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:08Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b74fe1-2600-4fd3-93dc-1ca1c8b8a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b74fe1-2600-4fd3-93dc-1ca1c8b8a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2e39aa-54c7-4c3b-9648-978b2d24674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2e39aa-54c7-4c3b-9648-978b2d24674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0420c02-370c-47dc-8015-85a4136983e4', 'volume_name': 'volume-d0420c02-370c-47dc-8015-85a4136983e4', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8f902a-2903-47a8-9451-90d092142370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8f902a-2903-47a8-9451-90d092142370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c7b4e5-2420-4541-b57e-bd86a80516dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Volume d0420c02-370c-47dc-8015-85a4136983e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0420c02-370c-47dc-8015-85a4136983e4', 'volume_size': 1} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-644408861',display_name='tempest-VolumesGetTest-Volume-38381485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0420c02-370c-47dc-8015-85a4136983e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:08Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Creating volume d0420c02-370c-47dc-8015-85a4136983e4 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:07 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:07 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 1073741824 Sep 28 21:41:07 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:08 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 1073741824" returned: 0 in 0.610s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:08 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 Sep 28 21:41:08 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] GroupSnapshot 7368568c-039c-4cab-ae9f-d2fcf28c87b3: creating. Sep 28 21:41:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Group snapshot 7368568c-039c-4cab-ae9f-d2fcf28c87b3: creating. {{(pid=86489) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 21:41:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:09 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4" returned: 0 in 0.497s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.365s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Creating offline snapshot 6aef5a67-7312-46a2-b452-dbf8cf553f97 of volume 9e8efe66-669e-4c5e-a4f9-6de314701e51 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c7b4e5-2420-4541-b57e-bd86a80516dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0420c02-370c-47dc-8015-85a4136983e4', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cfd6a6-703e-4366-bcee-a173dabbce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f8d0ac-3229-4437-ad0e-bd8848102ac0]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:09 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Volume volume-d0420c02-370c-47dc-8015-85a4136983e4 (d0420c02-370c-47dc-8015-85a4136983e4): created successfully Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cfd6a6-703e-4366-bcee-a173dabbce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (de8458b7-edae-4d4a-9d94-b3e050e46d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:09 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2c70d4cc-8360-4fb9-a924-31a15b7b7f74 tempest-VolumesGetTest-1878182973 None] Created volume successfully. Sep 28 21:41:09 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 Sep 28 21:41:09 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:09 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51" returned: 0 in 0.416s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:09 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 1G Sep 28 21:41:09 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:10 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 1G" returned: 0 in 0.922s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-d0420c02-370c-47dc-8015-85a4136983e4-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Lock "cinder-d0420c02-370c-47dc-8015-85a4136983e4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:10 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 Sep 28 21:41:10 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-d0420c02-370c-47dc-8015-85a4136983e4" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-d0420c02-370c-47dc-8015-85a4136983e4" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:10 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a30c76-5bb6-41bd-a54b-0631e56e5363]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:11 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 Sep 28 21:41:11 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:11 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97" returned: 0 in 0.620s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:11 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:11 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 Sep 28 21:41:11 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:11 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4" returned: 0 in 0.605s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:11 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4 Sep 28 21:41:11 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:11 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97" returned: 0 in 0.451s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:11 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.info Sep 28 21:41:11 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:11 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0420c02-370c-47dc-8015-85a4136983e4" returned: 0 in 0.337s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-d0420c02-370c-47dc-8015-85a4136983e4" released by "delete_volume" :: held 1.064s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Created reservations ['08dda494-c83b-4645-b927-1a00acb21cc2', '9a00efb9-e558-4111-a990-7642b3d3197b', '797ace6d-e565-4f5e-9ca4-2c639cba5b44', 'd81b8aa1-6c09-440d-b4c4-7b553f033786'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:12 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:12 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:12 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.info" returned: 0 in 0.424s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:12 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:41:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:12 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.info Sep 28 21:41:12 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:12 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.411s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:12 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:12 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Deleted volume successfully. Sep 28 21:41:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-77d0b40c-91c4-441f-a4b7-100252e33be6 tempest-VolumesGetTest-1878182973 None] Lock "cinder-d0420c02-370c-47dc-8015-85a4136983e4-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:12 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.info" returned: 0 in 0.442s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.447s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:12 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e70cbe00-034c-47bf-8f5f-70edbb2c17a7 tempest-GroupSnapshotsTest-659546145 None] group_snapshot 7368568c-039c-4cab-ae9f-d2fcf28c87b3: created successfully Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-e3772454-f844-487a-bc7a-59305fb92c27-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Lock "cinder-e3772454-f844-487a-bc7a-59305fb92c27-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-e3772454-f844-487a-bc7a-59305fb92c27" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-e3772454-f844-487a-bc7a-59305fb92c27" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8fd933-773e-4063-be6b-0e2412ee2b75]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:13 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 Sep 28 21:41:13 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:13 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] group_snapshot 7368568c-039c-4cab-ae9f-d2fcf28c87b3: deleting Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] group_snapshot 7368568c-039c-4cab-ae9f-d2fcf28c87b3: deleting {{(pid=86489) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-9e8efe66-669e-4c5e-a4f9-6de314701e51" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-9e8efe66-669e-4c5e-a4f9-6de314701e51" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-6aef5a67-7312-46a2-b452-dbf8cf553f97" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-6aef5a67-7312-46a2-b452-dbf8cf553f97" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Deleting offline snapshot 6aef5a67-7312-46a2-b452-dbf8cf553f97 of volume 9e8efe66-669e-4c5e-a4f9-6de314701e51 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] snapshot_file for this snap is: volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d68f65-6069-47bd-bbc5-47581b42f0d4]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:13 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27" returned: 0 in 0.575s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:13 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27 Sep 28 21:41:13 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:14 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 Sep 28 21:41:14 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:14 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e3772454-f844-487a-bc7a-59305fb92c27" returned: 0 in 0.414s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-e3772454-f844-487a-bc7a-59305fb92c27" released by "delete_volume" :: held 1.108s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:14 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97" returned: 0 in 0.607s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e8efe66-669e-4c5e-a4f9-6de314701e51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Created reservations ['e45d6c00-a819-490c-b1aa-c779a7a8d299', 'c1fe16ec-76e7-49d1-91b9-75bbbd8077d8', '972fa241-4f43-4d48-bf79-9d59434d6818', 'bed68868-e840-4290-b454-3cdf29c24d17'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf932c6-572b-479c-82f2-9b297c868693]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:14 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:14 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:14 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 Sep 28 21:41:14 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:15 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51" returned: 0 in 0.566s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:15 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.476s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Deleted volume successfully. Sep 28 21:41:15 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 Sep 28 21:41:15 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4876531d-9517-449a-b4e8-73ad97b69620 tempest-VolumesGetTest-1878182973 None] Lock "cinder-e3772454-f844-487a-bc7a-59305fb92c27-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:15 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97" returned: 0 in 0.640s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-fb4cb80c-db6c-4faf-8615-eb9992c488b7-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:15 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97 Sep 28 21:41:15 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Lock "cinder-fb4cb80c-db6c-4faf-8615-eb9992c488b7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-fb4cb80c-db6c-4faf-8615-eb9992c488b7" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-fb4cb80c-db6c-4faf-8615-eb9992c488b7" acquired by "delete_volume" :: waited 0.041s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8279370e-7afd-4a67-abd3-c3874542eaf6]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:16 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 Sep 28 21:41:16 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:16 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51.6aef5a67-7312-46a2-b452-dbf8cf553f97" returned: 0 in 0.491s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-6aef5a67-7312-46a2-b452-dbf8cf553f97" released by "_delete_snapshot" :: held 2.525s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-9e8efe66-669e-4c5e-a4f9-6de314701e51" released by "delete_snapshot" :: held 2.587s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:16 devstack cinder-volume[86489]: WARNING cinder.quota [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-628986861 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-628986861, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:41:16 devstack cinder-volume[86489]: WARNING cinder.quota [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-628986861 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-628986861, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:41:16 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] Created reservations ['46d3c515-aebf-4d33-89cb-f6bf9ce94dea', 'a5aa79a8-0ce1-4e8e-a4e1-ced7bf10a035', 'ba4ca94b-b97a-4a2b-8d75-a894b86e2c4c', '47d6e314-057c-4c69-a70d-e8b6db823914'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-75dc01f2-c02f-489d-9066-3eb9c7f196b5 tempest-GroupSnapshotsTest-659546145 None] group_snapshot 7368568c-039c-4cab-ae9f-d2fcf28c87b3: deleted successfully Sep 28 21:41:16 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7" returned: 0 in 0.586s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:16 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7 Sep 28 21:41:16 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:16 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fb4cb80c-db6c-4faf-8615-eb9992c488b7" returned: 0 in 0.327s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-fb4cb80c-db6c-4faf-8615-eb9992c488b7" released by "delete_volume" :: held 1.018s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Created reservations ['1e8b9d6c-81ba-4099-8b2c-80d5d32c4e97', 'ed6cb082-524b-4e6a-9a27-7035e74f1c31', '7963d60a-6b64-4bd8-98b5-5217ba2df47a', '62d11887-1d7a-401e-95fb-30def5e63fed'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:17 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:17 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:17 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Deleted volume successfully. Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80b48cf2-5b8d-4d63-87ae-cd7fc4ef72c4 tempest-VolumesGetTest-1878182973 None] Lock "cinder-fb4cb80c-db6c-4faf-8615-eb9992c488b7-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "cinder-quobyte-9e8efe66-669e-4c5e-a4f9-6de314701e51" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-9e8efe66-669e-4c5e-a4f9-6de314701e51" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76ddf03-4109-4bcb-a1e8-a1999e585a98]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:17 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 Sep 28 21:41:17 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:18 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51" returned: 0 in 0.572s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:18 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51 Sep 28 21:41:18 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:18 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9e8efe66-669e-4c5e-a4f9-6de314701e51" returned: 0 in 0.349s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Lock "cinder-quobyte-9e8efe66-669e-4c5e-a4f9-6de314701e51" released by "delete_volume" :: held 1.004s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:18 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Created reservations ['0acab971-244c-482d-9ac7-f247c70b25dd'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:18 devstack cinder-volume[86489]: WARNING cinder.quota [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-628986861 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-628986861, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:41:18 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Created reservations ['955fd01a-d1b5-45ab-b774-5b0de0d9ffc9', '36f49c2f-7cd7-4125-9de7-bd777f653ad8', '9655d422-ce0d-4a71-a5cf-e7926c0daf32', '2dccf79e-f532-4946-8e0c-b2f34b59247a'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:19 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:19 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:19 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.425s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6109d53d-64eb-4178-b35d-f28d7580a14b tempest-GroupSnapshotsTest-659546145 None] Delete group completed successfully. Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (07e97a26-fbff-451c-a5ff-8d59e3db80fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2b9898-a2b1-4cab-a657-69acb3b28575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2b9898-a2b1-4cab-a657-69acb3b28575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-830492277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a9c1a4-fdb4-45db-afa8-2a966a11f30f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:20Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae207dc9-9acb-4391-9168-8f5ba406579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae207dc9-9acb-4391-9168-8f5ba406579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc84082-67f9-42db-832f-6e7e78f8619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:19 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:41:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc84082-67f9-42db-832f-6e7e78f8619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30a9c1a4-fdb4-45db-afa8-2a966a11f30f', 'volume_name': 'volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9448eedf-200b-4f64-a97b-702293395642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9448eedf-200b-4f64-a97b-702293395642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35af877f-8704-4d87-90f7-28a79ab81571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:20 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Volume 30a9c1a4-fdb4-45db-afa8-2a966a11f30f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 21:41:20 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Trying to clone 30a9c1a4-fdb4-45db-afa8-2a966a11f30f from image 3995c6d3-b961-4789-8642-3546544acbf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:41:21 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:41:21 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Image download 20.69 MB at 20.69 MB/s Sep 28 21:41:21 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08bd1b3-3298-4017-86ce-460fdc34ca69]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:21 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD Sep 28 21:41:21 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:22 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 is fetched for user ee40f4e858264260afc0cc4cd1137970. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abe7380-e64c-4710-925b-308fd8b1aa46]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:22 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD Sep 28 21:41:22 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:22 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-830492277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a9c1a4-fdb4-45db-afa8-2a966a11f30f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:20Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Creating volume 30a9c1a4-fdb4-45db-afa8-2a966a11f30f {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:22 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:22 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f 1073741824 Sep 28 21:41:22 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:23 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f 1073741824" returned: 0 in 0.657s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:23 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f Sep 28 21:41:23 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:23 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f" returned: 0 in 0.358s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:23 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Attempting download of 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume 30a9c1a4-fdb4-45db-afa8-2a966a11f30f. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:41:23 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcf34fc-def7-475d-99aa-2dcc0c90330b]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_6tewbchn {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:24 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_6tewbchn Sep 28 21:41:24 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:24 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_6tewbchn" returned: 0 in 0.499s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_6tewbchn {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:24 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_6tewbchn Sep 28 21:41:24 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:24 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_6tewbchn" returned: 1 in 0.477s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_6tewbchn' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:41:24 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[42920127-840b-43c1-a97e-b9464c2e8003]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:25 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD Sep 28 21:41:25 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:25 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD" returned: 0 in 0.519s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:25 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] 3995c6d3-b961-4789-8642-3546544acbf3 was qcow2, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:41:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:25 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f Sep 28 21:41:25 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Flow 'volume_create_manager' (f0c31d0f-1196-4896-a19a-0565105f38ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e57504f-dd53-490b-b13b-3ee099f8b24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e57504f-dd53-490b-b13b-3ee099f8b24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1379647859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdff70e7-c080-49b8-ac06-c47b26ef12c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9480e5cd6f1a4511b4030c591aa3f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:26Z,use_quota=True,user_id='c3bc3795bfe546febb7a47a7a0f2f788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc4466a-258b-4cb3-a640-e9001169fb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc4466a-258b-4cb3-a640-e9001169fb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e21113f-b7fe-4fc5-b941-9ccb2953d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e21113f-b7fe-4fc5-b941-9ccb2953d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdff70e7-c080-49b8-ac06-c47b26ef12c0', 'volume_name': 'volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed775ac5-54ce-4c2b-a88d-f54b4c627528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed775ac5-54ce-4c2b-a88d-f54b4c627528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926e600b-00fd-41f1-9273-c50443a98684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Volume cdff70e7-c080-49b8-ac06-c47b26ef12c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0', 'volume_size': 1} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1379647859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdff70e7-c080-49b8-ac06-c47b26ef12c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9480e5cd6f1a4511b4030c591aa3f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:26Z,use_quota=True,user_id='c3bc3795bfe546febb7a47a7a0f2f788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Creating volume cdff70e7-c080-49b8-ac06-c47b26ef12c0 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:26 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:26 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 1073741824 Sep 28 21:41:26 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Flow 'volume_create_manager' (10ec5f0c-8686-4ff0-89aa-bcac09c0b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6015e349-665a-4268-941c-1de2b5d152e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6015e349-665a-4268-941c-1de2b5d152e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1689737234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7aec41-3471-4cc3-b64e-4a49ba5266a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9480e5cd6f1a4511b4030c591aa3f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:27Z,use_quota=True,user_id='c3bc3795bfe546febb7a47a7a0f2f788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205bc1ae-31bc-4387-9864-050691b0b873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205bc1ae-31bc-4387-9864-050691b0b873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98a9821-66cc-4dc0-91d6-fb68fbc114bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98a9821-66cc-4dc0-91d6-fb68fbc114bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7aec41-3471-4cc3-b64e-4a49ba5266a2', 'volume_name': 'volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffb8ec3-e8dc-44e9-b13d-9de6dd4bb61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffb8ec3-e8dc-44e9-b13d-9de6dd4bb61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccf801c-0d5b-44c8-8938-876a5c8dcc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Volume 2a7aec41-3471-4cc3-b64e-4a49ba5266a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2', 'volume_size': 1} Sep 28 21:41:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:27 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 1073741824" returned: 0 in 0.612s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:27 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 Sep 28 21:41:27 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:27 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0" returned: 0 in 0.341s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1689737234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7aec41-3471-4cc3-b64e-4a49ba5266a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9480e5cd6f1a4511b4030c591aa3f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:27Z,use_quota=True,user_id='c3bc3795bfe546febb7a47a7a0f2f788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Creating volume 2a7aec41-3471-4cc3-b64e-4a49ba5266a2 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:27 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926e600b-00fd-41f1-9273-c50443a98684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0de9c9-3cb4-45aa-b1d6-8ce2fad06786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:27 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 1073741824 Sep 28 21:41:27 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Volume volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 (cdff70e7-c080-49b8-ac06-c47b26ef12c0): created successfully Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0de9c9-3cb4-45aa-b1d6-8ce2fad06786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Flow 'volume_create_manager' (f0c31d0f-1196-4896-a19a-0565105f38ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a4a998e8-64a3-4ff8-9643-1b26b8dae32d tempest-TestServerVolumeAttachmentScenario-626459438 None] Created volume successfully. Sep 28 21:41:27 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f" returned: 0 in 2.541s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_3nqivmc4devstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:41:27 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Converted 112.00 MB image at 44.06 MB/s Sep 28 21:41:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:27 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f 1G Sep 28 21:41:27 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:28 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 1073741824" returned: 0 in 0.613s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:28 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 Sep 28 21:41:28 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:28 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f 1G" returned: 0 in 0.487s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Downloaded image 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume 30a9c1a4-fdb4-45db-afa8-2a966a11f30f successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 for user ee40f4e858264260afc0cc4cd1137970 is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Marking volume 30a9c1a4-fdb4-45db-afa8-2a966a11f30f as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Copying metadata from image 3995c6d3-b961-4789-8642-3546544acbf3 to 30a9c1a4-fdb4-45db-afa8-2a966a11f30f. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Creating volume glance metadata for volume 30a9c1a4-fdb4-45db-afa8-2a966a11f30f backed by image 3995c6d3-b961-4789-8642-3546544acbf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:41:28 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2" returned: 0 in 0.316s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccf801c-0d5b-44c8-8938-876a5c8dcc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfc7aa3-beb3-4983-8ccd-8a1739a7e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:28 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Volume volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 (2a7aec41-3471-4cc3-b64e-4a49ba5266a2): created successfully Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfc7aa3-beb3-4983-8ccd-8a1739a7e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Flow 'volume_create_manager' (10ec5f0c-8686-4ff0-89aa-bcac09c0b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b584e096-2b4f-46f5-997a-1fc2be9f5d1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Created volume successfully. Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35af877f-8704-4d87-90f7-28a79ab81571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65274747-1bf2-4107-a0d1-7b315cb9237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:28 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Volume volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f (30a9c1a4-fdb4-45db-afa8-2a966a11f30f): created successfully Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65274747-1bf2-4107-a0d1-7b315cb9237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (07e97a26-fbff-451c-a5ff-8d59e3db80fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5e95ed9b-fbfa-4ca9-ba6d-c47b8c9d4e4d tempest-VolumesGetTest-1878182973 None] Created volume successfully. Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (6b05ad1e-b8b8-4683-ad3e-6c0b690d7550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1a2e7d-59d6-4b18-9dd5-242c2b3cd6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1a2e7d-59d6-4b18-9dd5-242c2b3cd6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1826740338',display_name='tempest-VolumesGetTest-Volume-1963942989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe579899-d20a-40d4-8665-4bdbb62883f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:30Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374bd389-7ff4-4bc7-b310-ecdd8601facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374bd389-7ff4-4bc7-b310-ecdd8601facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25da92f2-bd88-4333-a59f-040275c10bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25da92f2-bd88-4333-a59f-040275c10bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe579899-d20a-40d4-8665-4bdbb62883f7', 'volume_name': 'volume-fe579899-d20a-40d4-8665-4bdbb62883f7', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebdd4d3-4ecb-4bdf-836b-cd3de2431631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebdd4d3-4ecb-4bdf-836b-cd3de2431631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3b1c2f-cb6a-489f-ae14-e849a23e88ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Volume fe579899-d20a-40d4-8665-4bdbb62883f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe579899-d20a-40d4-8665-4bdbb62883f7', 'volume_size': 1} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1826740338',display_name='tempest-VolumesGetTest-Volume-1963942989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe579899-d20a-40d4-8665-4bdbb62883f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4091f846b6cc41b6aea06293d26d46a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:30Z,use_quota=True,user_id='ee40f4e858264260afc0cc4cd1137970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Creating volume fe579899-d20a-40d4-8665-4bdbb62883f7 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:30 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:30 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 1073741824 Sep 28 21:41:30 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:31 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 1073741824" returned: 0 in 0.578s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:31 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 Sep 28 21:41:31 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:31 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3b1c2f-cb6a-489f-ae14-e849a23e88ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe579899-d20a-40d4-8665-4bdbb62883f7', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a521c7-f996-46c0-b984-ceb3c93896b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Volume volume-fe579899-d20a-40d4-8665-4bdbb62883f7 (fe579899-d20a-40d4-8665-4bdbb62883f7): created successfully Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a521c7-f996-46c0-b984-ceb3c93896b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Flow 'volume_create_manager' (6b05ad1e-b8b8-4683-ad3e-6c0b690d7550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1d7ccd0b-4fc3-4866-a90e-ee57b10b3295 tempest-VolumesGetTest-1878182973 None] Created volume successfully. Sep 28 21:41:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-fe579899-d20a-40d4-8665-4bdbb62883f7-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Lock "cinder-fe579899-d20a-40d4-8665-4bdbb62883f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-fe579899-d20a-40d4-8665-4bdbb62883f7" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-fe579899-d20a-40d4-8665-4bdbb62883f7" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:33 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe36356-80c0-4fe5-b193-81f212ec2ee2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:33 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 Sep 28 21:41:33 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:33 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7" returned: 0 in 0.464s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:33 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7 Sep 28 21:41:33 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:33 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-fe579899-d20a-40d4-8665-4bdbb62883f7" returned: 0 in 0.318s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-fe579899-d20a-40d4-8665-4bdbb62883f7" released by "delete_volume" :: held 0.850s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:33 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Created reservations ['392e2c09-04fe-49c5-a1c9-68c33c80838c', 'de464924-233c-493c-99da-a231b238325b', 'ad2d0a32-4d7d-4e4c-9462-f9fe677e05fe', 'af091c20-b7df-4d36-b203-e4caee9eca43'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:34 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:34 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-30a9c1a4-fdb4-45db-afa8-2a966a11f30f-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Lock "cinder-30a9c1a4-fdb4-45db-afa8-2a966a11f30f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Acquiring lock "cinder-quobyte-30a9c1a4-fdb4-45db-afa8-2a966a11f30f" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-30a9c1a4-fdb4-45db-afa8-2a966a11f30f" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:34 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.487s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Deleted volume successfully. Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b5e0f9-f07d-4d9f-9797-b1835b8966fb]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1aa4de71-a458-4ade-ab63-f12c7e39618b tempest-VolumesGetTest-1878182973 None] Lock "cinder-fe579899-d20a-40d4-8665-4bdbb62883f7-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:34 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f Sep 28 21:41:34 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:34 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f" returned: 0 in 0.419s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:35 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f Sep 28 21:41:35 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:35 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30a9c1a4-fdb4-45db-afa8-2a966a11f30f" returned: 0 in 0.272s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Lock "cinder-quobyte-30a9c1a4-fdb4-45db-afa8-2a966a11f30f" released by "delete_volume" :: held 0.775s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Created reservations ['5322a7e8-7259-4c07-9aa1-740949c3b258', '04aaf951-72eb-4b61-ae89-4c0107bbc000', '47c00f13-6c33-4820-81a2-e1bc3571517a', '579f7e6c-5b6c-4c44-b9d4-c0b87c9d0b0a'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:35 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:35 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:35 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.320s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Deleted volume successfully. Sep 28 21:41:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0119a167-2c5e-4715-9ab7-d9817a8fc553 tempest-VolumesGetTest-1878182973 None] Lock "cinder-30a9c1a4-fdb4-45db-afa8-2a966a11f30f-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Flow 'volume_create_manager' (6a03c051-74c9-416e-b984-55f26a92afa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4833b3-5975-4ab0-be7c-e41f29c8fe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4833b3-5975-4ab0-be7c-e41f29c8fe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-151624369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beded3f9-8a08-4760-adfd-6c6f061caf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a855b6ca7c74917801c3d23b4e480d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:37Z,use_quota=True,user_id='3da903def67d450584835d61f7411cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91ac21d-6f5a-4ff6-b164-47c78d1826a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91ac21d-6f5a-4ff6-b164-47c78d1826a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87789546-1a57-4718-b861-20c7dae436d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87789546-1a57-4718-b861-20c7dae436d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beded3f9-8a08-4760-adfd-6c6f061caf9a', 'volume_name': 'volume-beded3f9-8a08-4760-adfd-6c6f061caf9a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a32213-4503-4f61-93e4-bd6993558ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a32213-4503-4f61-93e4-bd6993558ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9393cfae-5cb6-44f2-8c6e-2dd0f15abc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:37 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Volume beded3f9-8a08-4760-adfd-6c6f061caf9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beded3f9-8a08-4760-adfd-6c6f061caf9a', 'volume_size': 1} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-151624369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beded3f9-8a08-4760-adfd-6c6f061caf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a855b6ca7c74917801c3d23b4e480d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:37Z,use_quota=True,user_id='3da903def67d450584835d61f7411cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Creating volume beded3f9-8a08-4760-adfd-6c6f061caf9a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:37 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:37 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a 1073741824 Sep 28 21:41:37 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-79d1edce-31e4-4ebf-913b-eef7b742c587 tempest-GroupsTest-357654024 None] Group tempest-Group1-206962098: creating Sep 28 21:41:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-79d1edce-31e4-4ebf-913b-eef7b742c587 tempest-GroupsTest-357654024 None] Group tempest-Group1-206962098: created successfully Sep 28 21:41:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-79d1edce-31e4-4ebf-913b-eef7b742c587 tempest-GroupsTest-357654024 None] Create group completed successfully. Sep 28 21:41:38 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a 1073741824" returned: 0 in 0.665s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:38 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a Sep 28 21:41:38 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:38 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a" returned: 0 in 0.359s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=151,cinder:SELECT=140,cinder:DELETE=6,cinder:INSERT=40 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9393cfae-5cb6-44f2-8c6e-2dd0f15abc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beded3f9-8a08-4760-adfd-6c6f061caf9a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc933141-c6db-4131-afeb-c851ae2d7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=121,cinder:UPDATE=148,cinder:INSERT=42,cinder:DELETE=11 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:41:38 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Volume volume-beded3f9-8a08-4760-adfd-6c6f061caf9a (beded3f9-8a08-4760-adfd-6c6f061caf9a): created successfully Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc933141-c6db-4131-afeb-c851ae2d7199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Flow 'volume_create_manager' (6a03c051-74c9-416e-b984-55f26a92afa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ea15ff3c-d4d4-49be-809a-051895da4af7 tempest-AttachVolumeTestJSON-1772433899 None] Created volume successfully. Sep 28 21:41:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8b203745-7757-4e5b-b87d-caa858ab132b tempest-GroupsTest-357654024 None] Group tempest-Group2-246980730: creating Sep 28 21:41:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8b203745-7757-4e5b-b87d-caa858ab132b tempest-GroupsTest-357654024 None] Group tempest-Group2-246980730: created successfully Sep 28 21:41:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8b203745-7757-4e5b-b87d-caa858ab132b tempest-GroupsTest-357654024 None] Create group completed successfully. Sep 28 21:41:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-6cdfc184-3ee9-473d-867e-7274003271ee req-30d30b89-7a8e-4c78-952d-8fad3f975970 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-6cdfc184-3ee9-473d-867e-7274003271ee req-30d30b89-7a8e-4c78-952d-8fad3f975970 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-6cdfc184-3ee9-473d-867e-7274003271ee req-30d30b89-7a8e-4c78-952d-8fad3f975970 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-6cdfc184-3ee9-473d-867e-7274003271ee req-30d30b89-7a8e-4c78-952d-8fad3f975970 tempest-AttachVolumeTestJSON-1772433899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-beded3f9-8a08-4760-adfd-6c6f061caf9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f46ec95-349c-4edb-acd3-abfd8200a3e6', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:41:40 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-6cdfc184-3ee9-473d-867e-7274003271ee req-30d30b89-7a8e-4c78-952d-8fad3f975970 tempest-AttachVolumeTestJSON-1772433899 None] attachment_update completed successfully. Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Flow 'volume_create_manager' (6bc6bf65-18c6-4dc2-9a59-8d867cae5423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9110f701-2988-4b1b-b0ca-41b5c681847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9110f701-2988-4b1b-b0ca-41b5c681847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648853411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2160799-b52b-4418-9c42-27af193f5ebc,host='devstack@QuobyteHD#QuobyteHD',id=344e7d27-be92-4470-8ee9-c3ddbb2640ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b1577f5654d898eee7af840a22874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:41Z,use_quota=True,user_id='a849de3ff34c422da0aa6a843411e01a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be868a20-d460-49b4-aacb-7c7ec5686e01),volume_type_id=be868a20-d460-49b4-aacb-7c7ec5686e01)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6829009f-86d6-4416-8d37-dd18bd20eea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6829009f-86d6-4416-8d37-dd18bd20eea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb62cc4-abd5-46a1-9074-5a5fcf92e0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb62cc4-abd5-46a1-9074-5a5fcf92e0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344e7d27-be92-4470-8ee9-c3ddbb2640ea', 'volume_name': 'volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6559aa20-d39a-458b-be4e-ff2311eccbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6559aa20-d39a-458b-be4e-ff2311eccbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35eab74-fbf4-429a-9068-28ca04654117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:41 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Volume 344e7d27-be92-4470-8ee9-c3ddbb2640ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea', 'volume_size': 1} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c2160799-b52b-4418-9c42-27af193f5ebc,created_at=2026-09-28T19:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648853411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2160799-b52b-4418-9c42-27af193f5ebc,host='devstack@QuobyteHD#QuobyteHD',id=344e7d27-be92-4470-8ee9-c3ddbb2640ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b1577f5654d898eee7af840a22874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:41Z,use_quota=True,user_id='a849de3ff34c422da0aa6a843411e01a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be868a20-d460-49b4-aacb-7c7ec5686e01),volume_type_id=be868a20-d460-49b4-aacb-7c7ec5686e01)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Creating volume 344e7d27-be92-4470-8ee9-c3ddbb2640ea {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:41 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:41 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea 1073741824 Sep 28 21:41:41 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:42 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea 1073741824" returned: 0 in 0.940s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:42 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea Sep 28 21:41:42 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:42 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea" returned: 0 in 0.383s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35eab74-fbf4-429a-9068-28ca04654117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cbf912-83d3-436d-bb03-d38d9810c8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:42 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Volume volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea (344e7d27-be92-4470-8ee9-c3ddbb2640ea): created successfully Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cbf912-83d3-436d-bb03-d38d9810c8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Flow 'volume_create_manager' (6bc6bf65-18c6-4dc2-9a59-8d867cae5423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-639fe44f-aedd-47c7-9f76-bf1197579116 tempest-GroupsTest-357654024 None] Created volume successfully. Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Flow 'volume_create_manager' (369bae8f-080b-4d6c-a0eb-041426b3c41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c523b91-b369-4207-9ba9-03de9fdbc27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c523b91-b369-4207-9ba9-03de9fdbc27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-979719482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e54ea47-0ac3-4d52-8ca9-ec776bdb3761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a855b6ca7c74917801c3d23b4e480d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:44Z,use_quota=True,user_id='3da903def67d450584835d61f7411cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2d5dd4-0cb8-46eb-9101-a8fcad6d9a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2d5dd4-0cb8-46eb-9101-a8fcad6d9a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a275b4e1-c6ed-41e9-932b-8fa025460afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a275b4e1-c6ed-41e9-932b-8fa025460afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e54ea47-0ac3-4d52-8ca9-ec776bdb3761', 'volume_name': 'volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac627b3-7d00-41f2-a6b4-c67381fcaf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac627b3-7d00-41f2-a6b4-c67381fcaf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aaf3cd4-2d14-4a8a-822f-e48e8bed1ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:44 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Volume 2e54ea47-0ac3-4d52-8ca9-ec776bdb3761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761', 'volume_size': 1} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-979719482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e54ea47-0ac3-4d52-8ca9-ec776bdb3761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a855b6ca7c74917801c3d23b4e480d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:44Z,use_quota=True,user_id='3da903def67d450584835d61f7411cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Creating volume 2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:44 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:44 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 1073741824 Sep 28 21:41:44 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Acquiring lock "cinder-quobyte-344e7d27-be92-4470-8ee9-c3ddbb2640ea" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Lock "cinder-quobyte-344e7d27-be92-4470-8ee9-c3ddbb2640ea" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f29092-2514-463c-ab2a-990e24b7fe02]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:45 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 1073741824" returned: 0 in 0.611s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:45 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 Sep 28 21:41:45 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:45 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea Sep 28 21:41:45 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:45 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761" returned: 0 in 0.363s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:45 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea" returned: 0 in 0.489s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aaf3cd4-2d14-4a8a-822f-e48e8bed1ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e1b315-442e-4612-9eaa-662041a8f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:45 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea Sep 28 21:41:45 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:45 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Volume volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 (2e54ea47-0ac3-4d52-8ca9-ec776bdb3761): created successfully Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e1b315-442e-4612-9eaa-662041a8f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Flow 'volume_create_manager' (369bae8f-080b-4d6c-a0eb-041426b3c41a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:45 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f2a8b440-2b2c-4f79-a941-a7b5049f95f8 tempest-AttachVolumeTestJSON-1772433899 None] Created volume successfully. Sep 28 21:41:45 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-344e7d27-be92-4470-8ee9-c3ddbb2640ea" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Lock "cinder-quobyte-344e7d27-be92-4470-8ee9-c3ddbb2640ea" released by "delete_volume" :: held 0.823s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Created reservations ['b47b3e88-5e94-4537-bb1d-3ed8ae7df516'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:45 devstack cinder-volume[86489]: WARNING cinder.quota [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1218254302 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1218254302, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:41:45 devstack cinder-volume[86489]: WARNING cinder.quota [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1218254302 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1218254302, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:41:45 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Created reservations ['a49ae22a-0a2d-412a-8482-6c2598f0748c', '8e95ed49-5da5-4115-b26e-6a201836a3d8', '2785cd39-4fd0-4427-8587-2f44988c55c4', '8630f8d0-fea8-4dda-9e45-5c67a8b0975c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:46 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:46 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:46 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.302s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-74c88cc1-b5a7-4d8a-b60a-a5ae3f5dc5bc tempest-GroupsTest-357654024 None] Delete group completed successfully. Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Created reservations ['120af79a-6991-4f54-9eea-9f01210e9b7e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:46 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:46 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Flow 'volume_create_manager' (d69f57c1-e668-44df-8365-137d5201b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8079b902-b7a3-4391-89ab-06b67e0baca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:47 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8079b902-b7a3-4391-89ab-06b67e0baca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1444824622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64faa3fd-1776-4ce9-964f-c054f3f8f781,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb58fc6026c4f8ebcf956f51f7faac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:47Z,use_quota=True,user_id='8b63595610f94ddcbd3845258e4506e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bccf9f-955b-4b58-ada2-cd7b4d58dbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bccf9f-955b-4b58-ada2-cd7b4d58dbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163bb7a6-3c3a-45c6-98a5-9c44f106dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163bb7a6-3c3a-45c6-98a5-9c44f106dbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64faa3fd-1776-4ce9-964f-c054f3f8f781', 'volume_name': 'volume-64faa3fd-1776-4ce9-964f-c054f3f8f781', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18336024-34d1-457a-a51e-6a25bef696df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18336024-34d1-457a-a51e-6a25bef696df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545f2b29-68a8-43a3-912f-8eb046cb4a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:47 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Volume 64faa3fd-1776-4ce9-964f-c054f3f8f781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64faa3fd-1776-4ce9-964f-c054f3f8f781', 'volume_size': 1} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1444824622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64faa3fd-1776-4ce9-964f-c054f3f8f781,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb58fc6026c4f8ebcf956f51f7faac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:47Z,use_quota=True,user_id='8b63595610f94ddcbd3845258e4506e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Creating volume 64faa3fd-1776-4ce9-964f-c054f3f8f781 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:47 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.546s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5ca36d70-49eb-4117-8950-0f7f379b8830 tempest-GroupsTest-357654024 None] Delete group completed successfully. Sep 28 21:41:47 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 1073741824 Sep 28 21:41:47 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-e1d00834-2db8-4d06-8574-bef73b579498 req-03d6818a-a0a8-4ac5-b80a-9d7fee520b96 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:47 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 1073741824" returned: 0 in 0.544s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:47 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 Sep 28 21:41:47 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:48 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781" returned: 0 in 0.295s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-e1d00834-2db8-4d06-8574-bef73b579498 req-03d6818a-a0a8-4ac5-b80a-9d7fee520b96 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.509s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545f2b29-68a8-43a3-912f-8eb046cb4a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64faa3fd-1776-4ce9-964f-c054f3f8f781', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f20bf0-17aa-4f40-9972-ad97c803d940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-e1d00834-2db8-4d06-8574-bef73b579498 req-03d6818a-a0a8-4ac5-b80a-9d7fee520b96 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Volume volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 (64faa3fd-1776-4ce9-964f-c054f3f8f781): created successfully Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f20bf0-17aa-4f40-9972-ad97c803d940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Flow 'volume_create_manager' (d69f57c1-e668-44df-8365-137d5201b888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-131ca8d4-beac-44d2-a096-20ef469a354f tempest-VolumesListTestJSON-1607180804 None] Created volume successfully. Sep 28 21:41:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-e1d00834-2db8-4d06-8574-bef73b579498 req-03d6818a-a0a8-4ac5-b80a-9d7fee520b96 tempest-AttachVolumeTestJSON-1772433899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eef469dc-c2a9-4eb2-a07f-5e841c281cf9', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:41:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b28ac97c-c562-4854-af06-062d4b999f12 tempest-GroupsTest-357654024 None] Group tempest-GroupsTest-Group-502408688: creating Sep 28 21:41:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-e1d00834-2db8-4d06-8574-bef73b579498 req-03d6818a-a0a8-4ac5-b80a-9d7fee520b96 tempest-AttachVolumeTestJSON-1772433899 None] attachment_update completed successfully. Sep 28 21:41:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b28ac97c-c562-4854-af06-062d4b999f12 tempest-GroupsTest-357654024 None] Group tempest-GroupsTest-Group-502408688: created successfully Sep 28 21:41:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b28ac97c-c562-4854-af06-062d4b999f12 tempest-GroupsTest-357654024 None] Create group completed successfully. Sep 28 21:41:49 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Flow 'volume_create_manager' (3bffc966-4e6d-4eac-9a73-6d9f49854b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6495f76b-31e9-456b-9344-a0e6c5c03006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6495f76b-31e9-456b-9344-a0e6c5c03006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-822621607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe4a365-34ef-4b6f-a77e-7e2198f6bad0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb58fc6026c4f8ebcf956f51f7faac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:50Z,use_quota=True,user_id='8b63595610f94ddcbd3845258e4506e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1341f5-3a69-4770-bb9d-30675bcccac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1341f5-3a69-4770-bb9d-30675bcccac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b26691-d954-4f9e-abfb-44c302483092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b26691-d954-4f9e-abfb-44c302483092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe4a365-34ef-4b6f-a77e-7e2198f6bad0', 'volume_name': 'volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a85ff99-0e98-4c6c-89a4-6175ca45cd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a85ff99-0e98-4c6c-89a4-6175ca45cd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd2f87c-6f6f-4d8b-aa73-87d868cdb81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Volume dbe4a365-34ef-4b6f-a77e-7e2198f6bad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0', 'volume_size': 1} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-822621607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe4a365-34ef-4b6f-a77e-7e2198f6bad0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb58fc6026c4f8ebcf956f51f7faac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:50Z,use_quota=True,user_id='8b63595610f94ddcbd3845258e4506e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Creating volume dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:50 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:50 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 1073741824 Sep 28 21:41:50 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Flow 'volume_create_manager' (e9707f65-f556-40ec-816d-1c46126c8d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89dd607f-a6da-4bb9-a8ef-2b437551a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89dd607f-a6da-4bb9-a8ef-2b437551a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366139295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1a2b8e8b-661d-4b60-bb73-8e9b8d0e5cf3,host='devstack@QuobyteHD#QuobyteHD',id=b1be4819-d0d0-4a48-a693-ecf3a1d7847a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b1577f5654d898eee7af840a22874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:50Z,use_quota=True,user_id='a849de3ff34c422da0aa6a843411e01a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a42a06e0-3aa3-4ccd-b5bd-61ea7463e1e6),volume_type_id=a42a06e0-3aa3-4ccd-b5bd-61ea7463e1e6)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf739db-fc1a-4367-8c74-b5d4732a79b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf739db-fc1a-4367-8c74-b5d4732a79b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f91700-c693-4976-8b56-de881b6cf863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f91700-c693-4976-8b56-de881b6cf863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1be4819-d0d0-4a48-a693-ecf3a1d7847a', 'volume_name': 'volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54194b1a-9005-4feb-ae76-5b0d4be73913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54194b1a-9005-4feb-ae76-5b0d4be73913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc7e0fd-cec4-4451-a189-ca10ab1b6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Volume b1be4819-d0d0-4a48-a693-ecf3a1d7847a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a', 'volume_size': 1} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:50 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 1073741824" returned: 0 in 0.618s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:50 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 Sep 28 21:41:50 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:50 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0" returned: 0 in 0.274s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1a2b8e8b-661d-4b60-bb73-8e9b8d0e5cf3,created_at=2026-09-28T19:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366139295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1a2b8e8b-661d-4b60-bb73-8e9b8d0e5cf3,host='devstack@QuobyteHD#QuobyteHD',id=b1be4819-d0d0-4a48-a693-ecf3a1d7847a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b1577f5654d898eee7af840a22874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:50Z,use_quota=True,user_id='a849de3ff34c422da0aa6a843411e01a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a42a06e0-3aa3-4ccd-b5bd-61ea7463e1e6),volume_type_id=a42a06e0-3aa3-4ccd-b5bd-61ea7463e1e6)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Creating volume b1be4819-d0d0-4a48-a693-ecf3a1d7847a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:51 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd2f87c-6f6f-4d8b-aa73-87d868cdb81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1b016a-aa20-496e-8f61-77dc2ea0e58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:51 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a 1073741824 Sep 28 21:41:51 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:51 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Volume volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 (dbe4a365-34ef-4b6f-a77e-7e2198f6bad0): created successfully Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1b016a-aa20-496e-8f61-77dc2ea0e58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Flow 'volume_create_manager' (3bffc966-4e6d-4eac-9a73-6d9f49854b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-caf3a38a-0368-4750-be7b-37d7036dd4c0 req-24cf9859-7bc2-4981-9a47-36750dadb770 tempest-AttachVolumeTestJSON-1772433899 None] Terminate volume connection completed successfully. Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-caf3a38a-0368-4750-be7b-37d7036dd4c0 req-24cf9859-7bc2-4981-9a47-36750dadb770 tempest-AttachVolumeTestJSON-1772433899 None] Deleting attachment 2f46ec95-349c-4edb-acd3-abfd8200a3e6. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:41:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-abb22f48-9dbc-4d5e-997e-46ae65ee1d6c tempest-VolumesListTestJSON-1607180804 None] Created volume successfully. Sep 28 21:41:51 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a 1073741824" returned: 0 in 0.567s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:51 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a Sep 28 21:41:51 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:51 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc7e0fd-cec4-4451-a189-ca10ab1b6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bd0883-7239-4d26-96a5-f22291d92718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Volume volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a (b1be4819-d0d0-4a48-a693-ecf3a1d7847a): created successfully Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bd0883-7239-4d26-96a5-f22291d92718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Flow 'volume_create_manager' (e9707f65-f556-40ec-816d-1c46126c8d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9a116f4d-af4b-4f4a-ac6e-d9bcfb62bf3f tempest-GroupsTest-357654024 None] Created volume successfully. Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Flow 'volume_create_manager' (6a9c5e50-70da-440c-9e87-f3e873f4b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb654e9d-bb75-442e-975a-466e575b53ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb654e9d-bb75-442e-975a-466e575b53ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2107898822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431c4fef-11ff-4587-8568-6da457258eaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb58fc6026c4f8ebcf956f51f7faac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:52Z,use_quota=True,user_id='8b63595610f94ddcbd3845258e4506e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1460710-990d-4632-96da-37eec3ff697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1460710-990d-4632-96da-37eec3ff697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caa9717-aafc-4d10-9340-343e94e91af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caa9717-aafc-4d10-9340-343e94e91af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431c4fef-11ff-4587-8568-6da457258eaa', 'volume_name': 'volume-431c4fef-11ff-4587-8568-6da457258eaa', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0997f7-3c08-40f9-8e5f-1f296015c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0997f7-3c08-40f9-8e5f-1f296015c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d064bf42-d616-4079-833c-9c5786712bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Volume 431c4fef-11ff-4587-8568-6da457258eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431c4fef-11ff-4587-8568-6da457258eaa', 'volume_size': 1} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2107898822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431c4fef-11ff-4587-8568-6da457258eaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb58fc6026c4f8ebcf956f51f7faac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:52Z,use_quota=True,user_id='8b63595610f94ddcbd3845258e4506e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Creating volume 431c4fef-11ff-4587-8568-6da457258eaa {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:52 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-d128ad41-beb9-428a-b45a-047bb48b33b4 req-2c9e188f-83a1-4eed-b679-8dfc4ead997f tempest-AttachVolumeTestJSON-1772433899 None] Terminate volume connection completed successfully. Sep 28 21:41:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-d128ad41-beb9-428a-b45a-047bb48b33b4 req-2c9e188f-83a1-4eed-b679-8dfc4ead997f tempest-AttachVolumeTestJSON-1772433899 None] Deleting attachment eef469dc-c2a9-4eb2-a07f-5e841c281cf9. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:41:52 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa 1073741824 Sep 28 21:41:52 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:53 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa 1073741824" returned: 0 in 0.514s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:53 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa Sep 28 21:41:53 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Flow 'volume_create_manager' (32bf3f54-8819-482c-aa5d-93924212fffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b6670e-2a6e-4c29-9cd6-308a0d58fab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b6670e-2a6e-4c29-9cd6-308a0d58fab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-45778948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1a2b8e8b-661d-4b60-bb73-8e9b8d0e5cf3,host='devstack@QuobyteHD#QuobyteHD',id=8b626b42-70ca-412d-9bb4-bddb8d299125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b1577f5654d898eee7af840a22874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:53Z,use_quota=True,user_id='a849de3ff34c422da0aa6a843411e01a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a42a06e0-3aa3-4ccd-b5bd-61ea7463e1e6),volume_type_id=a42a06e0-3aa3-4ccd-b5bd-61ea7463e1e6)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a7cd88-57ae-482c-b403-6022ce9f76d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a7cd88-57ae-482c-b403-6022ce9f76d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd326c49-2ccd-4355-9bbb-46976a9ff7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd326c49-2ccd-4355-9bbb-46976a9ff7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b626b42-70ca-412d-9bb4-bddb8d299125', 'volume_name': 'volume-8b626b42-70ca-412d-9bb4-bddb8d299125', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc259750-c72b-43aa-99fe-6e7568ce8dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc259750-c72b-43aa-99fe-6e7568ce8dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d518690d-c702-4d50-a020-64b6e15e23f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:53 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Volume 8b626b42-70ca-412d-9bb4-bddb8d299125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b626b42-70ca-412d-9bb4-bddb8d299125', 'volume_size': 1} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:53 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa" returned: 0 in 0.329s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.077s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1a2b8e8b-661d-4b60-bb73-8e9b8d0e5cf3,created_at=2026-09-28T19:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-45778948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1a2b8e8b-661d-4b60-bb73-8e9b8d0e5cf3,host='devstack@QuobyteHD#QuobyteHD',id=8b626b42-70ca-412d-9bb4-bddb8d299125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b1577f5654d898eee7af840a22874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:41:53Z,use_quota=True,user_id='a849de3ff34c422da0aa6a843411e01a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a42a06e0-3aa3-4ccd-b5bd-61ea7463e1e6),volume_type_id=a42a06e0-3aa3-4ccd-b5bd-61ea7463e1e6)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Creating volume 8b626b42-70ca-412d-9bb4-bddb8d299125 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:41:53 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:53 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 1073741824 Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d064bf42-d616-4079-833c-9c5786712bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431c4fef-11ff-4587-8568-6da457258eaa', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:53 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec120f63-4ff8-46bd-bb42-fc086afe8d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:53 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Volume volume-431c4fef-11ff-4587-8568-6da457258eaa (431c4fef-11ff-4587-8568-6da457258eaa): created successfully Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec120f63-4ff8-46bd-bb42-fc086afe8d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Flow 'volume_create_manager' (6a9c5e50-70da-440c-9e87-f3e873f4b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:53 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5e30608e-b860-433a-88bc-63be3d6e5393 tempest-VolumesListTestJSON-1607180804 None] Created volume successfully. Sep 28 21:41:54 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 1073741824" returned: 0 in 0.539s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:54 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 Sep 28 21:41:54 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:54 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125" returned: 0 in 0.356s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d518690d-c702-4d50-a020-64b6e15e23f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b626b42-70ca-412d-9bb4-bddb8d299125', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a896d96-b365-4794-9abd-6815db6c7be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:41:54 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Volume volume-8b626b42-70ca-412d-9bb4-bddb8d299125 (8b626b42-70ca-412d-9bb4-bddb8d299125): created successfully Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a896d96-b365-4794-9abd-6815db6c7be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:41:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Flow 'volume_create_manager' (32bf3f54-8819-482c-aa5d-93924212fffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:41:54 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-216c5765-30dc-4064-ac66-9a8c75224905 tempest-GroupsTest-357654024 None] Created volume successfully. Sep 28 21:41:55 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-4226698e-2c31-444c-a8ef-3d68288ccf56 tempest-GroupsTest-357654024 None] Update group completed successfully. Sep 28 21:41:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "cinder-431c4fef-11ff-4587-8568-6da457258eaa-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-431c4fef-11ff-4587-8568-6da457258eaa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "cinder-quobyte-431c4fef-11ff-4587-8568-6da457258eaa" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-quobyte-431c4fef-11ff-4587-8568-6da457258eaa" acquired by "delete_volume" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76cd188-7f12-4d23-bb5f-c462c8d2d79c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:57 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa Sep 28 21:41:57 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:57 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-38ea63e8-d990-416a-8e46-03a8207c1829 tempest-GroupsTest-357654024 None] Update group completed successfully. Sep 28 21:41:57 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa" returned: 0 in 0.391s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:57 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa Sep 28 21:41:57 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:57 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-431c4fef-11ff-4587-8568-6da457258eaa" returned: 0 in 0.274s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-quobyte-431c4fef-11ff-4587-8568-6da457258eaa" released by "delete_volume" :: held 0.727s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Created reservations ['25e616b0-e5ea-47d2-8c86-40821cba34f9', 'ea8bdcb1-57bf-465b-81e1-ab3e06ed1190', '33d9a079-810d-4b81-bdbf-7242ad1fd68c', 'd3839ded-8ad9-4475-97d0-6e1687c8a9b1'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:57 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:57 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:58 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.303s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "cinder-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Deleted volume successfully. Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0ed0c3ef-7621-4a1e-ab8f-e3cbde2b1e7d tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-431c4fef-11ff-4587-8568-6da457258eaa-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "cinder-quobyte-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-quobyte-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a4771-9572-4c68-bec0-87b606b97464]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:58 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 Sep 28 21:41:58 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "cinder-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "cinder-quobyte-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-quobyte-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dadffdb-0a84-481f-bb5c-e9965f1710d3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:58 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0" returned: 0 in 0.408s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:58 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0 Sep 28 21:41:58 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:58 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 Sep 28 21:41:58 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:58 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0" returned: 0 in 0.266s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-quobyte-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0" released by "delete_volume" :: held 0.729s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Acquiring lock "cinder-quobyte-8b626b42-70ca-412d-9bb4-bddb8d299125" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Lock "cinder-quobyte-8b626b42-70ca-412d-9bb4-bddb8d299125" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[05514d3e-9bf3-4241-97d4-c973c1386c3e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:59 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761" returned: 0 in 0.468s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Created reservations ['b213189b-1bfe-4a2b-9808-ed832ffb08ac', 'bbbc6924-ee07-4b93-a4d6-904c2b8b641b', '545bfad5-9643-49e4-a9ca-d623786ec871', '38a0a3ca-46b4-4826-93c6-2491a9f472f3'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:59 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761 Sep 28 21:41:59 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:59 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 Sep 28 21:41:59 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:59 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:59 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:59 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761" returned: 0 in 0.328s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "cinder-64faa3fd-1776-4ce9-964f-c054f3f8f781-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-quobyte-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761" released by "delete_volume" :: held 0.864s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-64faa3fd-1776-4ce9-964f-c054f3f8f781-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "cinder-quobyte-64faa3fd-1776-4ce9-964f-c054f3f8f781" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-quobyte-64faa3fd-1776-4ce9-964f-c054f3f8f781" acquired by "delete_volume" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Created reservations ['7d7daeef-8d89-4e09-9f7b-edd60d91433c', 'f854155b-5c6d-4eaf-8af4-8fbff0695fc8', '378b020c-fefd-4806-8bc9-2dec5bb07d90', '375117c9-c756-4af0-908e-e7c502c86433'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:41:59 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[713099ca-592c-4b31-a391-fe9f909a4b32]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125" returned: 0 in 0.617s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:59 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.447s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:41:59 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125 Sep 28 21:41:59 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:59 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Deleted volume successfully. Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dcd0e0a8-2924-45b7-9911-892c79cae59a tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-dbe4a365-34ef-4b6f-a77e-7e2198f6bad0-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:41:59 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 Sep 28 21:41:59 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:41:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:41:59 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:41:59 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:00 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8b626b42-70ca-412d-9bb4-bddb8d299125" returned: 0 in 0.361s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Lock "cinder-quobyte-8b626b42-70ca-412d-9bb4-bddb8d299125" released by "delete_volume" :: held 1.057s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Acquiring lock "cinder-quobyte-b1be4819-d0d0-4a48-a693-ecf3a1d7847a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Lock "cinder-quobyte-b1be4819-d0d0-4a48-a693-ecf3a1d7847a" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:00 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.302s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Deleted volume successfully. Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d48ba2d-b25f-474e-bd60-628a998db399]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:00 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781" returned: 0 in 0.490s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c11496bd-64d4-4648-bf0d-19083f9609c2 tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-2e54ea47-0ac3-4d52-8ca9-ec776bdb3761-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:00 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781 Sep 28 21:42:00 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:00 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a Sep 28 21:42:00 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:00 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-64faa3fd-1776-4ce9-964f-c054f3f8f781" returned: 0 in 0.288s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-quobyte-64faa3fd-1776-4ce9-964f-c054f3f8f781" released by "delete_volume" :: held 0.872s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Created reservations ['c02c0404-2918-4eb4-9b43-5697d343a74d', 'bee1fb7b-0c27-4bdf-a0c3-a31e0c1dfafd', '6fa8e768-cf8e-4463-baff-928277efc936', 'f663555d-aa10-4353-a344-3931b49e6ff6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:00 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a" returned: 0 in 0.422s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:00 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a Sep 28 21:42:00 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:00 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:00 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "cinder-beded3f9-8a08-4760-adfd-6c6f061caf9a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:00 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-beded3f9-8a08-4760-adfd-6c6f061caf9a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b1be4819-d0d0-4a48-a693-ecf3a1d7847a" returned: 0 in 0.351s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Lock "cinder-quobyte-b1be4819-d0d0-4a48-a693-ecf3a1d7847a" released by "delete_volume" :: held 0.867s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "cinder-quobyte-beded3f9-8a08-4760-adfd-6c6f061caf9a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:01 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.421s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Deleted volume successfully. Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-quobyte-beded3f9-8a08-4760-adfd-6c6f061caf9a" acquired by "delete_volume" :: waited 0.046s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc2cfbd0-eeb2-4d03-bcdd-2d78f1ba8953 tempest-VolumesListTestJSON-1607180804 None] Lock "cinder-64faa3fd-1776-4ce9-964f-c054f3f8f781-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1934d95-6572-4a4b-a2b2-3d8f3df59fb5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Created reservations ['88d39a82-3309-4afc-b5e9-ea998887618b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:01 devstack cinder-volume[86489]: WARNING cinder.quota [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-465034791 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-465034791, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:42:01 devstack cinder-volume[86489]: WARNING cinder.quota [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-465034791 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-465034791, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Created reservations ['d0da0678-1bbc-4ea9-a2a6-d7b05cbbcd7a', '6575b44a-f483-4c99-aeb6-11db627a881c', '25dbe52b-5db3-40a0-a14b-efc457203be3', '2e5ccabc-364d-4073-b4c3-95d95b3be591'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:01 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a Sep 28 21:42:01 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Created reservations ['91e4ef89-4ef0-4b66-867f-419b587be1ac', 'be070b9e-aad2-4c41-becd-f52a114675e3', '187cfa95-39ef-4266-a0f5-41ff891514e6', 'efa53b64-2bc0-43d1-8145-8ad741ab0834'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:01 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:01 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:01 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a" returned: 0 in 0.515s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:01 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a Sep 28 21:42:01 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:01 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.296s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7442aa3d-211e-4cd1-bc56-054823b4aca9 tempest-GroupsTest-357654024 None] Delete group completed successfully. Sep 28 21:42:01 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-beded3f9-8a08-4760-adfd-6c6f061caf9a" returned: 0 in 0.261s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-quobyte-beded3f9-8a08-4760-adfd-6c6f061caf9a" released by "delete_volume" :: held 0.857s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Created reservations ['430fde06-496a-4680-807b-8d0023afd5d7', '42b96c71-21e1-411c-9122-4522308fca90', '72f389ba-0e2d-44e2-99f0-7d2a6cdc1180', 'cf279f5b-eb8e-432e-b3cc-3c227470f679'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:02 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:02 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:02 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.264s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:02 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Deleted volume successfully. Sep 28 21:42:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e4168c5-91fa-4e36-9b89-9b240c9c8432 tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-beded3f9-8a08-4760-adfd-6c6f061caf9a-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "cinder-45dc6933-c88c-4577-b865-fa67ae631746-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-45dc6933-c88c-4577-b865-fa67ae631746-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "cinder-quobyte-45dc6933-c88c-4577-b865-fa67ae631746" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-quobyte-45dc6933-c88c-4577-b865-fa67ae631746" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:03 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce366885-18c0-4e21-9ff1-c1b839706bdd]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:03 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 Sep 28 21:42:03 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:04 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746" returned: 0 in 0.528s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:04 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746 Sep 28 21:42:04 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7247c3ed-9319-4da9-8d92-7021f169c8e4 req-13c9a990-5848-4290-aaf8-132a3b2e9e3b tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7247c3ed-9319-4da9-8d92-7021f169c8e4 req-13c9a990-5848-4290-aaf8-132a3b2e9e3b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7247c3ed-9319-4da9-8d92-7021f169c8e4 req-13c9a990-5848-4290-aaf8-132a3b2e9e3b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7247c3ed-9319-4da9-8d92-7021f169c8e4 req-13c9a990-5848-4290-aaf8-132a3b2e9e3b tempest-TestServerVolumeAttachmentScenario-626459438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11c204d3-b2e1-48e7-b24a-b8a0da1241e0', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:42:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-7247c3ed-9319-4da9-8d92-7021f169c8e4 req-13c9a990-5848-4290-aaf8-132a3b2e9e3b tempest-TestServerVolumeAttachmentScenario-626459438 None] attachment_update completed successfully. Sep 28 21:42:04 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-45dc6933-c88c-4577-b865-fa67ae631746" returned: 0 in 0.312s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-quobyte-45dc6933-c88c-4577-b865-fa67ae631746" released by "delete_volume" :: held 0.908s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Created reservations ['540107f4-bf52-4edf-a04c-7360b533df47', 'daf22ebd-537d-4ad6-af45-e3db663b7935', 'cb8452dd-7190-46b5-bff1-41d278dfa324', '193c2089-1802-4047-8d61-2cb7b57bfb88'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:04 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:04 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:04 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.388s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:05 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Deleted volume successfully. Sep 28 21:42:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a420cd33-b4e1-4602-88e4-8cd3f05a09ff tempest-AttachVolumeTestJSON-1772433899 None] Lock "cinder-45dc6933-c88c-4577-b865-fa67ae631746-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:07 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:07 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:07 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.370s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 28 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:42:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:42:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-1bbc2778-1804-4d9f-993e-f1db42f0760f req-f03617b4-2bf3-428c-9f69-c72576e6b43b tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-1bbc2778-1804-4d9f-993e-f1db42f0760f req-f03617b4-2bf3-428c-9f69-c72576e6b43b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-1bbc2778-1804-4d9f-993e-f1db42f0760f req-f03617b4-2bf3-428c-9f69-c72576e6b43b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-1bbc2778-1804-4d9f-993e-f1db42f0760f req-f03617b4-2bf3-428c-9f69-c72576e6b43b tempest-TestServerVolumeAttachmentScenario-626459438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2e8189e-7c1f-43ef-a6f1-20b3ed8be358', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:42:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-1bbc2778-1804-4d9f-993e-f1db42f0760f req-f03617b4-2bf3-428c-9f69-c72576e6b43b tempest-TestServerVolumeAttachmentScenario-626459438 None] attachment_update completed successfully. Sep 28 21:42:13 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-b3478962-6f75-4cec-92a7-6ab59f68bb96 req-69258abc-2308-400b-8717-c2e7764a45f0 tempest-TestServerVolumeAttachmentScenario-626459438 None] Terminate volume connection completed successfully. Sep 28 21:42:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-b3478962-6f75-4cec-92a7-6ab59f68bb96 req-69258abc-2308-400b-8717-c2e7764a45f0 tempest-TestServerVolumeAttachmentScenario-626459438 None] Deleting attachment d2e8189e-7c1f-43ef-a6f1-20b3ed8be358. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:42:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-e1f3c0da-44e9-4bef-bf67-9790e03c08f2 req-a91aa443-6add-4989-8702-40532764f9c2 tempest-TestServerVolumeAttachmentScenario-626459438 None] Terminate volume connection completed successfully. Sep 28 21:42:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-e1f3c0da-44e9-4bef-bf67-9790e03c08f2 req-a91aa443-6add-4989-8702-40532764f9c2 tempest-TestServerVolumeAttachmentScenario-626459438 None] Deleting attachment 11c204d3-b2e1-48e7-b24a-b8a0da1241e0. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (7b951fb2-e1aa-40ac-8bc6-0c51d283a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b555fa-a54e-44f1-8869-12820e25d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b555fa-a54e-44f1-8869-12820e25d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1869084454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d373c53-3f4f-4108-a7be-320383a6f7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bcee601e24d9ca8cf82586099bccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:21Z,use_quota=True,user_id='bbc4a87f35e540a1af9a2278111bab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6bc38b-d131-4787-afbe-563dd9ce4096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6bc38b-d131-4787-afbe-563dd9ce4096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895b84e9-bd49-48af-8a14-ffd1e650982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895b84e9-bd49-48af-8a14-ffd1e650982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d373c53-3f4f-4108-a7be-320383a6f7ab', 'volume_name': 'volume-6d373c53-3f4f-4108-a7be-320383a6f7ab', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09023316-ae52-4e14-9163-dc39e7a79fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09023316-ae52-4e14-9163-dc39e7a79fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb1724a-8365-4bfc-a565-0ad22da16224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Volume 6d373c53-3f4f-4108-a7be-320383a6f7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d373c53-3f4f-4108-a7be-320383a6f7ab', 'volume_size': 1} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1869084454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d373c53-3f4f-4108-a7be-320383a6f7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bcee601e24d9ca8cf82586099bccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:21Z,use_quota=True,user_id='bbc4a87f35e540a1af9a2278111bab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Creating volume 6d373c53-3f4f-4108-a7be-320383a6f7ab {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:42:21 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:42:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:21 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab 1073741824 Sep 28 21:42:21 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:22 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab 1073741824" returned: 0 in 0.689s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:22 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab Sep 28 21:42:22 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:22 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab" returned: 0 in 0.298s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb1724a-8365-4bfc-a565-0ad22da16224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d373c53-3f4f-4108-a7be-320383a6f7ab', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20a1c14-123a-4c9f-a452-2eafb79f46ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Volume volume-6d373c53-3f4f-4108-a7be-320383a6f7ab (6d373c53-3f4f-4108-a7be-320383a6f7ab): created successfully Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20a1c14-123a-4c9f-a452-2eafb79f46ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (7b951fb2-e1aa-40ac-8bc6-0c51d283a952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:22 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1d0c21db-9c03-472d-a8be-bd66b023bfa4 tempest-VolumesSnapshotTestJSON-542291037 None] Created volume successfully. Sep 28 21:42:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Creating offline snapshot 20aba6f5-c745-4c9e-9adb-e09c52db6130 of volume 6d373c53-3f4f-4108-a7be-320383a6f7ab {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:42:24 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[db247393-607f-496c-afbe-f31e4facab70]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:24 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab Sep 28 21:42:24 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:24 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab" returned: 0 in 0.479s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:24 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 1G Sep 28 21:42:24 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:25 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 1G" returned: 0 in 0.644s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d373c53-3f4f-4108-a7be-320383a6f7ab -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:25 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d373c53-3f4f-4108-a7be-320383a6f7ab -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 Sep 28 21:42:25 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "cinder-2a7aec41-3471-4cc3-b64e-4a49ba5266a2-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "cinder-2a7aec41-3471-4cc3-b64e-4a49ba5266a2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "cinder-quobyte-2a7aec41-3471-4cc3-b64e-4a49ba5266a2" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "cinder-quobyte-2a7aec41-3471-4cc3-b64e-4a49ba5266a2" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[111233a7-5b5e-4ce1-8c6b-99d1201c5bf2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:25 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d373c53-3f4f-4108-a7be-320383a6f7ab -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130" returned: 0 in 0.388s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:25 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 is being set with open permissions: ugo+rw Sep 28 21:42:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:25 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 Sep 28 21:42:25 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:25 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 Sep 28 21:42:25 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:26 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130" returned: 0 in 0.424s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:26 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2" returned: 0 in 0.583s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:26 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2 Sep 28 21:42:26 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.info Sep 28 21:42:26 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:26 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:26 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2a7aec41-3471-4cc3-b64e-4a49ba5266a2" returned: 0 in 0.349s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "cinder-quobyte-2a7aec41-3471-4cc3-b64e-4a49ba5266a2" released by "delete_volume" :: held 1.002s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:26 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.info" returned: 0 in 0.442s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:26 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.info is being set with open permissions: ugo+rw Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:26 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.info Sep 28 21:42:26 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Created reservations ['b11ca666-def0-4844-9333-c91cfa613dfe', 'fc11ab97-4c2c-4dcd-b0d9-e4e58c0261ee', '6e26a47d-0f88-4840-a719-60e0cb1b734d', 'ffb998e8-5b2f-4f30-81cd-a9e1addb74ae'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:26 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:26 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:27 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.info" returned: 0 in 0.354s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.871s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2a9264f8-410d-4069-aa54-8484068966a3 tempest-VolumesSnapshotTestJSON-542291037 None] Create snapshot completed successfully Sep 28 21:42:27 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.382s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Deleted volume successfully. Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0df05217-8839-4737-9449-34b8eda39e28 tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "cinder-2a7aec41-3471-4cc3-b64e-4a49ba5266a2-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-20aba6f5-c745-4c9e-9adb-e09c52db6130-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-20aba6f5-c745-4c9e-9adb-e09c52db6130-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-6d373c53-3f4f-4108-a7be-320383a6f7ab" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-6d373c53-3f4f-4108-a7be-320383a6f7ab" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-20aba6f5-c745-4c9e-9adb-e09c52db6130" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-20aba6f5-c745-4c9e-9adb-e09c52db6130" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Deleting offline snapshot 20aba6f5-c745-4c9e-9adb-e09c52db6130 of volume 6d373c53-3f4f-4108-a7be-320383a6f7ab {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:42:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] snapshot_file for this snap is: volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b918dd5-aa06-4780-8269-584b5cc90b80]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "cinder-cdff70e7-c080-49b8-ac06-c47b26ef12c0-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Flow 'volume_create_manager' (69682125-7509-41f1-bfaf-52ef95a1edfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98879465-2d7a-48fb-88e1-589d9b7665d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "cinder-cdff70e7-c080-49b8-ac06-c47b26ef12c0-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98879465-2d7a-48fb-88e1-589d9b7665d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-323764950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705d6557-0233-4072-8288-71b68df41802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47010c595ad46d5ab5991d45afe8a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:28Z,use_quota=True,user_id='1ecdfb46b26744e69588f0065c1320fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd48c6b-cae3-47c8-bc3f-b54fc6561836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd48c6b-cae3-47c8-bc3f-b54fc6561836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c8e160-d604-4fa9-992c-c0a6baefa4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c8e160-d604-4fa9-992c-c0a6baefa4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705d6557-0233-4072-8288-71b68df41802', 'volume_name': 'volume-705d6557-0233-4072-8288-71b68df41802', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a613ee93-181b-47c6-ba05-d68da887e26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a613ee93-181b-47c6-ba05-d68da887e26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6e8428-8dc4-43c8-9ece-601c68410512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:28 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Volume 705d6557-0233-4072-8288-71b68df41802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705d6557-0233-4072-8288-71b68df41802', 'volume_size': 1} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-323764950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705d6557-0233-4072-8288-71b68df41802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47010c595ad46d5ab5991d45afe8a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:28Z,use_quota=True,user_id='1ecdfb46b26744e69588f0065c1320fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Creating volume 705d6557-0233-4072-8288-71b68df41802 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:42:28 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:28 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 Sep 28 21:42:28 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "cinder-quobyte-cdff70e7-c080-49b8-ac06-c47b26ef12c0" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:28 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 1073741824 Sep 28 21:42:28 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "cinder-quobyte-cdff70e7-c080-49b8-ac06-c47b26ef12c0" acquired by "delete_volume" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bf07bd-5007-4b33-aff7-db70b4a586a7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:28 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 Sep 28 21:42:28 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:28 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130" returned: 0 in 0.590s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d373c53-3f4f-4108-a7be-320383a6f7ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2215d76-0e06-4104-8cbd-00983ac162d3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:28 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 1073741824" returned: 0 in 0.569s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:28 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab Sep 28 21:42:28 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:28 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 Sep 28 21:42:28 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:28 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0" returned: 0 in 0.583s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:28 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0 Sep 28 21:42:28 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:29 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab" returned: 0 in 0.464s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:29 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6e8428-8dc4-43c8-9ece-601c68410512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705d6557-0233-4072-8288-71b68df41802', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:29 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 Sep 28 21:42:29 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7709e0-8dfd-4ebf-b7ec-d4fb0a3a714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:29 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:29 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Volume volume-705d6557-0233-4072-8288-71b68df41802 (705d6557-0233-4072-8288-71b68df41802): created successfully Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7709e0-8dfd-4ebf-b7ec-d4fb0a3a714c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Flow 'volume_create_manager' (69682125-7509-41f1-bfaf-52ef95a1edfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cdff70e7-c080-49b8-ac06-c47b26ef12c0" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "cinder-quobyte-cdff70e7-c080-49b8-ac06-c47b26ef12c0" released by "delete_volume" :: held 0.989s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-46c75167-c95b-4c6e-943b-ece2aa62c6f9 tempest-VolumeQuotasAdminTestJSON-979235947 None] Created volume successfully. Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Created reservations ['efb54a77-e80f-4df3-8c8f-e366fd0a42cc', '768b33e2-bec9-4b46-9a3c-852874913c0d', '2317e12d-d3a7-44f2-8062-ac83d736ccda', 'f3b12177-499a-4cf2-9245-51ceb91fe406'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:29 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:29 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:29 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130" returned: 0 in 0.440s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:29 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130 Sep 28 21:42:29 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:29 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.280s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Deleted volume successfully. Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-98673084-422f-42d4-aaaa-241b3cb28b1b tempest-TestServerVolumeAttachmentScenario-626459438 None] Lock "cinder-cdff70e7-c080-49b8-ac06-c47b26ef12c0-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:29 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab.20aba6f5-c745-4c9e-9adb-e09c52db6130" returned: 0 in 0.266s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-20aba6f5-c745-4c9e-9adb-e09c52db6130" released by "_delete_snapshot" :: held 1.946s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-6d373c53-3f4f-4108-a7be-320383a6f7ab" released by "delete_snapshot" :: held 1.981s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:29 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Created reservations ['7026a0ea-5a15-4aad-99b1-9487384b49a7', '0ba7f6d9-0bd2-4911-8ae7-b24120d90d54', '51c82504-5481-471f-aa60-eb3cb5f4052f', '5ee42c0d-64b0-437e-b3f1-49ca5b5accd7'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Delete snapshot completed successfully. Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d12081f7-2fcd-461d-a577-d54ef7f61dc4 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-20aba6f5-c745-4c9e-9adb-e09c52db6130-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Acquiring lock "cinder-705d6557-0233-4072-8288-71b68df41802-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "cinder-705d6557-0233-4072-8288-71b68df41802-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Acquiring lock "cinder-quobyte-705d6557-0233-4072-8288-71b68df41802" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "cinder-quobyte-705d6557-0233-4072-8288-71b68df41802" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[841bdf7c-96fe-44f4-905b-9f66190a4291]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:30 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 Sep 28 21:42:30 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:30 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802" returned: 0 in 0.389s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:30 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802 Sep 28 21:42:30 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:30 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-705d6557-0233-4072-8288-71b68df41802" returned: 0 in 0.269s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "cinder-quobyte-705d6557-0233-4072-8288-71b68df41802" released by "delete_volume" :: held 0.711s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:30 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Created reservations ['fa40a663-e033-42a6-822a-c75b2d39482d', '35d86eeb-46c8-4df4-b083-ed52f8ed2cd5', 'e22e2dc3-d0b1-4f8c-bc5c-11225eebad4a', '7c687c1a-468c-4e9f-ae31-fde70ceeb021'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:31 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:31 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:31 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.449s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Deleted volume successfully. Sep 28 21:42:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-20d1d0e4-62ad-42d9-bf57-078400114847 tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "cinder-705d6557-0233-4072-8288-71b68df41802-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (5fac7f0e-4476-4a4e-8204-0aacc7ed00d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37e3455-f0b5-4d8b-a208-e81ae113c537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37e3455-f0b5-4d8b-a208-e81ae113c537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1146373847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717ac8d9-5c20-4af9-a996-4387f06d787c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bcee601e24d9ca8cf82586099bccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:32Z,use_quota=True,user_id='bbc4a87f35e540a1af9a2278111bab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdd1a76-61f1-4d93-a77f-8d6afebcea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdd1a76-61f1-4d93-a77f-8d6afebcea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d806fdf-0cd5-427b-83ad-28a779cadb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d806fdf-0cd5-427b-83ad-28a779cadb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717ac8d9-5c20-4af9-a996-4387f06d787c', 'volume_name': 'volume-717ac8d9-5c20-4af9-a996-4387f06d787c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd48c44-890c-4c18-a3ea-9b188de107f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd48c44-890c-4c18-a3ea-9b188de107f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde5a525-bdb5-41b1-85d0-c27d6c5bf919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Volume 717ac8d9-5c20-4af9-a996-4387f06d787c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717ac8d9-5c20-4af9-a996-4387f06d787c', 'volume_size': 1} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1146373847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717ac8d9-5c20-4af9-a996-4387f06d787c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bcee601e24d9ca8cf82586099bccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:32Z,use_quota=True,user_id='bbc4a87f35e540a1af9a2278111bab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Creating volume 717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:42:32 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:32 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c 1073741824 Sep 28 21:42:32 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Flow 'volume_create_manager' (67c9ffbd-8e24-4acb-b7eb-42e7e7ee77b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e69c726-4cc8-4785-8f38-8a8de2a2d51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e69c726-4cc8-4785-8f38-8a8de2a2d51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1151373155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451f79ce-a79b-4d11-9155-859e74865494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47010c595ad46d5ab5991d45afe8a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:32Z,use_quota=True,user_id='1ecdfb46b26744e69588f0065c1320fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e5b0be-8e17-49ce-9bf4-b1efc2ab35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e5b0be-8e17-49ce-9bf4-b1efc2ab35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d8c95f-2267-4e1c-bb3c-f38fcc182f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d8c95f-2267-4e1c-bb3c-f38fcc182f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451f79ce-a79b-4d11-9155-859e74865494', 'volume_name': 'volume-451f79ce-a79b-4d11-9155-859e74865494', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac233300-76e5-4ed4-bdf0-26b2a3f3ba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac233300-76e5-4ed4-bdf0-26b2a3f3ba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995701f6-78c4-43e4-baba-d0c61d10e284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Volume 451f79ce-a79b-4d11-9155-859e74865494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451f79ce-a79b-4d11-9155-859e74865494', 'volume_size': 1} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:32 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c 1073741824" returned: 0 in 0.531s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:32 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c Sep 28 21:42:32 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:33 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c" returned: 0 in 0.299s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1151373155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451f79ce-a79b-4d11-9155-859e74865494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47010c595ad46d5ab5991d45afe8a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:32Z,use_quota=True,user_id='1ecdfb46b26744e69588f0065c1320fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Creating volume 451f79ce-a79b-4d11-9155-859e74865494 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:42:33 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde5a525-bdb5-41b1-85d0-c27d6c5bf919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717ac8d9-5c20-4af9-a996-4387f06d787c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:33 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 1073741824 Sep 28 21:42:33 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34141b57-1a91-42c0-b3de-bc92504ac356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Volume volume-717ac8d9-5c20-4af9-a996-4387f06d787c (717ac8d9-5c20-4af9-a996-4387f06d787c): created successfully Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34141b57-1a91-42c0-b3de-bc92504ac356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (5fac7f0e-4476-4a4e-8204-0aacc7ed00d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:33 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3c66668f-6c17-4be3-8afd-4498122a9ad3 tempest-VolumesSnapshotTestJSON-542291037 None] Created volume successfully. Sep 28 21:42:33 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 1073741824" returned: 0 in 0.562s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:33 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 Sep 28 21:42:33 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:33 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494" returned: 0 in 0.292s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:42:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995701f6-78c4-43e4-baba-d0c61d10e284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451f79ce-a79b-4d11-9155-859e74865494', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0589bd0b-8734-4280-9237-98934b75b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:34 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Volume volume-451f79ce-a79b-4d11-9155-859e74865494 (451f79ce-a79b-4d11-9155-859e74865494): created successfully Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0589bd0b-8734-4280-9237-98934b75b521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Flow 'volume_create_manager' (67c9ffbd-8e24-4acb-b7eb-42e7e7ee77b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-57affc5a-be56-42f8-9a9b-81fc600676cd tempest-VolumeQuotasAdminTestJSON-979235947 None] Created volume successfully. Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Creating offline snapshot a77729f5-5eec-4fa9-9342-f1269eda3e1a of volume 717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[082adb99-f686-4a52-be72-19363a9d4f0b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:34 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c Sep 28 21:42:34 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:34 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c" returned: 0 in 0.472s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:34 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a 1G Sep 28 21:42:34 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:35 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a 1G" returned: 0 in 0.683s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717ac8d9-5c20-4af9-a996-4387f06d787c -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:35 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717ac8d9-5c20-4af9-a996-4387f06d787c -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a Sep 28 21:42:35 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:35 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717ac8d9-5c20-4af9-a996-4387f06d787c -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a" returned: 0 in 0.431s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:35 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a is being set with open permissions: ugo+rw Sep 28 21:42:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:35 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a Sep 28 21:42:35 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:36 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a" returned: 0 in 0.304s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:36 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bad66c65-d14e-4867-8926-7b5a2fc581e8 tempest-VolumeQuotasAdminTestJSON-705762227 None] Transfer volume completed successfully. Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:36 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.info Sep 28 21:42:36 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:36 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.info" returned: 0 in 0.341s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:36 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.info is being set with open permissions: ugo+rw Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:36 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.info Sep 28 21:42:36 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Acquiring lock "cinder-451f79ce-a79b-4d11-9155-859e74865494-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Lock "cinder-451f79ce-a79b-4d11-9155-859e74865494-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Acquiring lock "cinder-quobyte-451f79ce-a79b-4d11-9155-859e74865494" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Lock "cinder-quobyte-451f79ce-a79b-4d11-9155-859e74865494" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:36 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.info" returned: 0 in 0.345s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:37 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0becb4d5-1e6a-41c9-9b19-49aa244c964d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-39e8a2f9-bc99-4648-a1bc-5e0732f0abc8 tempest-VolumesSnapshotTestJSON-542291037 None] Create snapshot completed successfully Sep 28 21:42:37 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 Sep 28 21:42:37 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:37 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494" returned: 0 in 0.550s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:37 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494 Sep 28 21:42:37 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:38 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-451f79ce-a79b-4d11-9155-859e74865494" returned: 0 in 0.567s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Lock "cinder-quobyte-451f79ce-a79b-4d11-9155-859e74865494" released by "delete_volume" :: held 1.195s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Created reservations ['b002aa96-767c-476f-85b6-dbf81da350f8', 'b466f525-2d01-45c9-a57b-0ccc389300a9', '9f7d5a02-c4d3-4c32-b085-f4ee0c9b4463', '5e51feee-5f55-410d-a1b9-678defbe4c18'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:38 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:38 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (ee967efe-f74a-448c-b34b-361ab4b77fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e925a9bb-266f-476c-96d4-b7610748fed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e925a9bb-266f-476c-96d4-b7610748fed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-793715345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bcee601e24d9ca8cf82586099bccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a77729f5-5eec-4fa9-9342-f1269eda3e1a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:38Z,use_quota=True,user_id='bbc4a87f35e540a1af9a2278111bab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1b7ca4-d71d-4e49-aaff-d41849bc916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1b7ca4-d71d-4e49-aaff-d41849bc916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698e73ad-9d16-4827-ac74-3d2f58d45f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698e73ad-9d16-4827-ac74-3d2f58d45f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84', 'volume_name': 'volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84', 'volume_size': 2, 'snapshot_id': 'a77729f5-5eec-4fa9-9342-f1269eda3e1a'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9285e83a-e214-4af8-bbbf-b64b0e867ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9285e83a-e214-4af8-bbbf-b64b0e867ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276d0779-50c3-46f6-857a-ef3e86aaf2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:38 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Volume b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84', 'volume_size': 2, 'snapshot_id': 'a77729f5-5eec-4fa9-9342-f1269eda3e1a'} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=166,cinder:DELETE=13,cinder:SELECT=154,cinder:INSERT=33 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-a77729f5-5eec-4fa9-9342-f1269eda3e1a-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-a77729f5-5eec-4fa9-9342-f1269eda3e1a-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Creating volume b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 from snapshot a77729f5-5eec-4fa9-9342-f1269eda3e1a {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] snapshot: a77729f5-5eec-4fa9-9342-f1269eda3e1a, volume: b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:42:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=159,cinder:UPDATE=163,cinder:DELETE=10,cinder:INSERT=39 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:42:39 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.607s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[965dc0f8-3d76-4007-83e9-882433127cfc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Deleted volume successfully. Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-55b7ae61-155e-4ee1-bd80-3836a4c4ded2 tempest-VolumeQuotasAdminTestJSON-576324219 None] Lock "cinder-451f79ce-a79b-4d11-9155-859e74865494-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:39 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a Sep 28 21:42:39 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:39 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a" returned: 0 in 0.681s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717ac8d9-5c20-4af9-a996-4387f06d787c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b007357-6540-4231-a187-175196d7bfe3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:39 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c Sep 28 21:42:39 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:40 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c" returned: 0 in 0.577s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:42:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:42:40 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:42:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:40 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 Sep 28 21:42:40 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:49 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:42:52 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" returned: 0 in 11.702s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c, size 1024.00 MB, duration 11.70 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:42:52 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Converted 1024.00 MB image at 87.50 MB/s Sep 28 21:42:52 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 is being set with open permissions: ugo+rw Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:52 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 Sep 28 21:42:52 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:52 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" returned: 0 in 0.339s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" released by "_copy_volume_from_snapshot" :: held 13.461s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-a77729f5-5eec-4fa9-9342-f1269eda3e1a-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" released by "_create_volume_from_snapshot" :: held 13.579s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.613s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276d0779-50c3-46f6-857a-ef3e86aaf2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84', 'volume_size': 2, 'snapshot_id': 'a77729f5-5eec-4fa9-9342-f1269eda3e1a'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93c86c3-6cbc-4e19-92ef-ba43bae9698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Volume volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 (b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84): created successfully Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93c86c3-6cbc-4e19-92ef-ba43bae9698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (ee967efe-f74a-448c-b34b-361ab4b77fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e60d31e2-5fc0-40cd-b5cf-f18fadf1c7f9 tempest-VolumesSnapshotTestJSON-542291037 None] Created volume successfully. Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" acquired by "delete_volume" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9183cd8-7f12-4e3b-8e28-0c02fd393984]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:53 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 Sep 28 21:42:53 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:53 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" returned: 0 in 0.420s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:53 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84 Sep 28 21:42:53 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:53 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84" released by "delete_volume" :: held 0.736s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Created reservations ['4f3ab3b4-c76c-4a02-9a4c-4204b084d99d', '199bf58e-045c-469a-afdf-164f6e6c6a89', '39ecc02e-2903-4af8-ba91-049a4f0e22ea', '33cf0865-145c-4413-85ea-ac9755151df9'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:53 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:53 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-a77729f5-5eec-4fa9-9342-f1269eda3e1a-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-a77729f5-5eec-4fa9-9342-f1269eda3e1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-717ac8d9-5c20-4af9-a996-4387f06d787c" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-717ac8d9-5c20-4af9-a996-4387f06d787c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-a77729f5-5eec-4fa9-9342-f1269eda3e1a" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-a77729f5-5eec-4fa9-9342-f1269eda3e1a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Deleting offline snapshot a77729f5-5eec-4fa9-9342-f1269eda3e1a of volume 717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] snapshot_file for this snap is: volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53cb03c-d983-45b4-887f-069486521719]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:54 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.445s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:54 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Deleted volume successfully. Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-059c7e41-4c5f-481d-ad04-e717fa5f8900 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-b6f0f473-ebb6-4493-8acb-6bdfbb1f0b84-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:54 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a Sep 28 21:42:54 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:54 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a" returned: 0 in 0.456s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717ac8d9-5c20-4af9-a996-4387f06d787c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3754d7-2be6-4bd2-a6bc-8dc71463ffc1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:54 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c Sep 28 21:42:54 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:55 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c" returned: 0 in 0.621s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:55 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a Sep 28 21:42:55 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:55 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a" returned: 0 in 0.397s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:55 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a Sep 28 21:42:55 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:55 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:42:55 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Flow 'volume_create_manager' (fb52c08b-504c-46bf-8ae1-c7b697e20a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc239412-588d-488f-85c0-96582ed2f73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc239412-588d-488f-85c0-96582ed2f73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1423969814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708167ec-cd8a-48c4-81c9-693b19e0f3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78050ad6f7349f6b1d448844f96d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:56Z,use_quota=True,user_id='8090df0fcef647ad89a7897a87a61895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b38305d-29f9-4a4c-af4e-65579445e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b38305d-29f9-4a4c-af4e-65579445e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a2f6e7-6ebd-4ce4-85ac-9657e55e29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a2f6e7-6ebd-4ce4-85ac-9657e55e29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708167ec-cd8a-48c4-81c9-693b19e0f3bf', 'volume_name': 'volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1a2ead-d8b1-4e89-a466-4773f12d9f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:56 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1a2ead-d8b1-4e89-a466-4773f12d9f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64087534-fd9f-4a0c-af01-41d22346281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:56 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Volume 708167ec-cd8a-48c4-81c9-693b19e0f3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf', 'volume_size': 1} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1423969814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708167ec-cd8a-48c4-81c9-693b19e0f3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78050ad6f7349f6b1d448844f96d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:56Z,use_quota=True,user_id='8090df0fcef647ad89a7897a87a61895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Creating volume 708167ec-cd8a-48c4-81c9-693b19e0f3bf {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:42:56 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c.a77729f5-5eec-4fa9-9342-f1269eda3e1a" returned: 0 in 0.303s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:56 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf 1073741824 Sep 28 21:42:56 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-a77729f5-5eec-4fa9-9342-f1269eda3e1a" released by "_delete_snapshot" :: held 1.921s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-717ac8d9-5c20-4af9-a996-4387f06d787c" released by "delete_snapshot" :: held 1.948s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Created reservations ['09192c69-9d83-4cf2-bc85-0901f4d66605', '80823771-b46d-4e53-ad99-dfc85271a84e', '20ccb8f9-e407-4efb-b011-4c60cf7fb976', '37620a06-68c5-44a3-b762-4088977b8383'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Delete snapshot completed successfully. Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c4262ee2-4fe6-43af-a728-f3f68e4bad44 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-a77729f5-5eec-4fa9-9342-f1269eda3e1a-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-717ac8d9-5c20-4af9-a996-4387f06d787c-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-717ac8d9-5c20-4af9-a996-4387f06d787c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-717ac8d9-5c20-4af9-a996-4387f06d787c" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-717ac8d9-5c20-4af9-a996-4387f06d787c" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f7fd9-4d24-4fe0-ade6-4a6663f9337e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:56 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf 1073741824" returned: 0 in 0.601s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:56 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c Sep 28 21:42:56 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:56 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf Sep 28 21:42:56 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:57 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:57 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf" returned: 0 in 0.309s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c" returned: 0 in 0.450s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64087534-fd9f-4a0c-af01-41d22346281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:57 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c Sep 28 21:42:57 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66664a2f-0b40-4db9-a42d-923919eca686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:57 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Volume volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf (708167ec-cd8a-48c4-81c9-693b19e0f3bf): created successfully Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66664a2f-0b40-4db9-a42d-923919eca686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Flow 'volume_create_manager' (fb52c08b-504c-46bf-8ae1-c7b697e20a10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:57 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fe9298ce-e5ab-4c2e-bdd7-144319d4f51d tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Created volume successfully. Sep 28 21:42:57 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-717ac8d9-5c20-4af9-a996-4387f06d787c" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-717ac8d9-5c20-4af9-a996-4387f06d787c" released by "delete_volume" :: held 0.779s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Created reservations ['b77f2204-22a7-45a6-8a67-3710dced4c6c', 'e99e111a-e55a-45b3-b45a-23938b5f0557', '5484c551-2ab7-4dc3-8960-d011a00738ab', '433e6083-2417-4d3b-a7a0-1c2136a8560a'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:57 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:42:57 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:57 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.268s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:42:57 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Deleted volume successfully. Sep 28 21:42:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-524a785b-d455-4c7f-9364-ff8d5223ef3e tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-717ac8d9-5c20-4af9-a996-4387f06d787c-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (ee51af79-3672-42e0-b16f-7055e2e2efc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd16e03d-61b8-44e5-9b1d-0886d7abe319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd16e03d-61b8-44e5-9b1d-0886d7abe319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1619440058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1a4f96-d97f-49f0-923a-2756bec96e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bcee601e24d9ca8cf82586099bccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:59Z,use_quota=True,user_id='bbc4a87f35e540a1af9a2278111bab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4546d324-3817-4057-ae87-b12446b9268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4546d324-3817-4057-ae87-b12446b9268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a5ed14-e146-454f-b91e-45ead125fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a5ed14-e146-454f-b91e-45ead125fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1a4f96-d97f-49f0-923a-2756bec96e9d', 'volume_name': 'volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53709d66-d0d1-4bd9-b0fa-0ff867422d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53709d66-d0d1-4bd9-b0fa-0ff867422d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508262f0-8fbb-4c6b-b5fc-fb13902c91e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:42:58 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Volume 8e1a4f96-d97f-49f0-923a-2756bec96e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d', 'volume_size': 1} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1619440058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1a4f96-d97f-49f0-923a-2756bec96e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bcee601e24d9ca8cf82586099bccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:42:59Z,use_quota=True,user_id='bbc4a87f35e540a1af9a2278111bab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Creating volume 8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:42:58 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:42:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:58 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d 1073741824 Sep 28 21:42:58 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:59 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 28 21:42:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d 1073741824" returned: 0 in 0.797s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:42:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:42:59 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d Sep 28 21:42:59 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:42:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Acquiring lock "cinder-708167ec-cd8a-48c4-81c9-693b19e0f3bf-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "cinder-708167ec-cd8a-48c4-81c9-693b19e0f3bf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Acquiring lock "cinder-quobyte-708167ec-cd8a-48c4-81c9-693b19e0f3bf" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:42:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "cinder-quobyte-708167ec-cd8a-48c4-81c9-693b19e0f3bf" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:42:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba258b08-1d4e-41a1-ae03-8a6b6cd88dfc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:42:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:00 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d" returned: 0 in 0.417s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508262f0-8fbb-4c6b-b5fc-fb13902c91e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84dade6-b7de-4ee1-9df9-4bac6f6eaeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:00 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Volume volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d (8e1a4f96-d97f-49f0-923a-2756bec96e9d): created successfully Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84dade6-b7de-4ee1-9df9-4bac6f6eaeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (ee51af79-3672-42e0-b16f-7055e2e2efc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:00 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf Sep 28 21:43:00 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-abb73c9f-60b8-4e02-8555-c7d464193e8f tempest-VolumesSnapshotTestJSON-542291037 None] Created volume successfully. Sep 28 21:43:00 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf" returned: 0 in 0.520s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:00 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf Sep 28 21:43:00 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:00 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-708167ec-cd8a-48c4-81c9-693b19e0f3bf" returned: 0 in 0.397s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "cinder-quobyte-708167ec-cd8a-48c4-81c9-693b19e0f3bf" released by "delete_volume" :: held 1.022s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Creating offline snapshot 9f40abdd-4dfd-446f-82e7-2c652c699ddf of volume 8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Created reservations ['ba096fc8-66bb-4832-9e99-05cd565e521c', '081bda31-604a-465e-a1c1-c6399763d264', '1165a288-402f-47c0-82b4-5052a8ba4ae3', '9a542629-c028-4015-9994-102e25901fb6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dd2af0-54f7-4891-86ec-6575b92559d2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:01 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:43:01 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:01 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d Sep 28 21:43:01 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:01 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.316s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:43:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Deleted volume successfully. Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a52bfa1-cae4-4fe1-9437-f8813f4f0b86 tempest-VolumeQuotasNegativeTestJSON-1409118525 None] Lock "cinder-708167ec-cd8a-48c4-81c9-693b19e0f3bf-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:01 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d" returned: 0 in 0.813s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:01 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf 1G Sep 28 21:43:01 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Flow 'volume_create_manager' (64afeb2c-a4fc-440c-9b24-0150aae84869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5247c9-2024-4239-b10d-167d7de4bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5247c9-2024-4239-b10d-167d7de4bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1956846844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab0ec42-67a5-480c-80a0-765d64dbc5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30262c26c6b84af2b4e3234f0132e7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:02Z,use_quota=True,user_id='555537f36df0446190174d03f0ab8fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec53b972-7c56-4c73-af4b-fcf7c5088634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec53b972-7c56-4c73-af4b-fcf7c5088634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a4e36c-b429-4aab-8389-80385e90647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a4e36c-b429-4aab-8389-80385e90647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab0ec42-67a5-480c-80a0-765d64dbc5a8', 'volume_name': 'volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd2ec4b-2b84-4685-850c-243564bebf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd2ec4b-2b84-4685-850c-243564bebf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf0e3e0-e5a8-441b-985d-f6fd113774a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:02 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Volume 3ab0ec42-67a5-480c-80a0-765d64dbc5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8', 'volume_size': 1} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:02 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf 1G" returned: 0 in 0.813s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:02 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf Sep 28 21:43:02 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:03 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf" returned: 0 in 0.398s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:03 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf is being set with open permissions: ugo+rw Sep 28 21:43:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:03 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf Sep 28 21:43:03 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:03 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf" returned: 0 in 0.428s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:03 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.info Sep 28 21:43:03 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:03 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.info" returned: 0 in 0.297s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:03 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.info is being set with open permissions: ugo+rw Sep 28 21:43:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:03 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.info Sep 28 21:43:03 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:04 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.info" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.289s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1956846844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab0ec42-67a5-480c-80a0-765d64dbc5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30262c26c6b84af2b4e3234f0132e7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:02Z,use_quota=True,user_id='555537f36df0446190174d03f0ab8fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Creating volume 3ab0ec42-67a5-480c-80a0-765d64dbc5a8 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:43:04 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:04 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 1073741824 Sep 28 21:43:04 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ab6af219-5c09-4171-9f99-c83b09cc92a7 tempest-VolumesSnapshotTestJSON-542291037 None] Create snapshot completed successfully Sep 28 21:43:04 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 1073741824" returned: 0 in 0.576s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:04 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 Sep 28 21:43:04 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:05 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8" returned: 0 in 0.401s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf0e3e0-e5a8-441b-985d-f6fd113774a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716b2076-cae7-4f64-b27a-378cbb584e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:05 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Volume volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 (3ab0ec42-67a5-480c-80a0-765d64dbc5a8): created successfully Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716b2076-cae7-4f64-b27a-378cbb584e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Flow 'volume_create_manager' (64afeb2c-a4fc-440c-9b24-0150aae84869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0943b0c7-2766-4b6d-bab2-acde929bdcd3 tempest-AttachVolumeNegativeTest-2091995112 None] Created volume successfully. Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (aa4bcd00-7404-4142-8509-fb790832c53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993e3c86-9906-4385-9271-db5f1df7745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993e3c86-9906-4385-9271-db5f1df7745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-912664299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fd2897-636a-4a35-a611-e249073ed9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0bcee601e24d9ca8cf82586099bccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f40abdd-4dfd-446f-82e7-2c652c699ddf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:06Z,use_quota=True,user_id='bbc4a87f35e540a1af9a2278111bab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d148cf30-8547-4601-bef2-3f11ec9a711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d148cf30-8547-4601-bef2-3f11ec9a711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d432e984-b2f6-4a5c-bded-fa3262271e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d432e984-b2f6-4a5c-bded-fa3262271e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33fd2897-636a-4a35-a611-e249073ed9d2', 'volume_name': 'volume-33fd2897-636a-4a35-a611-e249073ed9d2', 'volume_size': 1, 'snapshot_id': '9f40abdd-4dfd-446f-82e7-2c652c699ddf'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0207ee1a-b50c-4207-8245-6f53d6eff0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0207ee1a-b50c-4207-8245-6f53d6eff0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfa311c-f52f-45e6-a2a3-45656aec0cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:06 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Volume 33fd2897-636a-4a35-a611-e249073ed9d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33fd2897-636a-4a35-a611-e249073ed9d2', 'volume_size': 1, 'snapshot_id': '9f40abdd-4dfd-446f-82e7-2c652c699ddf'} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-9f40abdd-4dfd-446f-82e7-2c652c699ddf-33fd2897-636a-4a35-a611-e249073ed9d2" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-9f40abdd-4dfd-446f-82e7-2c652c699ddf-33fd2897-636a-4a35-a611-e249073ed9d2" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Creating volume 33fd2897-636a-4a35-a611-e249073ed9d2 from snapshot 9f40abdd-4dfd-446f-82e7-2c652c699ddf {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-33fd2897-636a-4a35-a611-e249073ed9d2" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-33fd2897-636a-4a35-a611-e249073ed9d2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] snapshot: 9f40abdd-4dfd-446f-82e7-2c652c699ddf, volume: 33fd2897-636a-4a35-a611-e249073ed9d2, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b7cffb-784e-435a-8a47-7083eeac6f9c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:06 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf Sep 28 21:43:06 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:06 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf" returned: 0 in 0.485s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7f0b98-3d09-4dbd-9771-aa4b642799ac]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:06 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d Sep 28 21:43:06 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:07 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d" returned: 0 in 0.627s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:07 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 Sep 28 21:43:07 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-69eefd95-c03d-4d5b-8db3-d5c30db80fd0 req-cab7523e-8c95-4ce8-8ad2-8cf166f724ff tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:07 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:43:07 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:07 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.298s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 28 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:43:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:43:15 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2" returned: 0 in 8.639s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:15 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:43:15 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Converted 1024.00 MB image at 118.52 MB/s Sep 28 21:43:15 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 is being set with open permissions: ugo+rw Sep 28 21:43:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:15 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 Sep 28 21:43:15 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:16 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2" returned: 0 in 0.299s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-33fd2897-636a-4a35-a611-e249073ed9d2" released by "_copy_volume_from_snapshot" :: held 10.171s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-9f40abdd-4dfd-446f-82e7-2c652c699ddf-33fd2897-636a-4a35-a611-e249073ed9d2" released by "_create_volume_from_snapshot" :: held 10.252s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.268s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-69eefd95-c03d-4d5b-8db3-d5c30db80fd0 req-cab7523e-8c95-4ce8-8ad2-8cf166f724ff tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.873s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-69eefd95-c03d-4d5b-8db3-d5c30db80fd0 req-cab7523e-8c95-4ce8-8ad2-8cf166f724ff tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfa311c-f52f-45e6-a2a3-45656aec0cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fd2897-636a-4a35-a611-e249073ed9d2', 'volume_size': 1, 'snapshot_id': '9f40abdd-4dfd-446f-82e7-2c652c699ddf'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335cf5c9-5f59-4e6f-ac1a-b06139a03238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:16 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Volume volume-33fd2897-636a-4a35-a611-e249073ed9d2 (33fd2897-636a-4a35-a611-e249073ed9d2): created successfully Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335cf5c9-5f59-4e6f-ac1a-b06139a03238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Flow 'volume_create_manager' (aa4bcd00-7404-4142-8509-fb790832c53a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-69eefd95-c03d-4d5b-8db3-d5c30db80fd0 req-cab7523e-8c95-4ce8-8ad2-8cf166f724ff tempest-AttachVolumeNegativeTest-2091995112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dac6789-4320-4caa-9778-b4631cff88b5', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:43:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0787baad-eefe-47cc-b621-1d39fea9d846 tempest-VolumesSnapshotTestJSON-542291037 None] Created volume successfully. Sep 28 21:43:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-69eefd95-c03d-4d5b-8db3-d5c30db80fd0 req-cab7523e-8c95-4ce8-8ad2-8cf166f724ff tempest-AttachVolumeNegativeTest-2091995112 None] attachment_update completed successfully. Sep 28 21:43:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-33fd2897-636a-4a35-a611-e249073ed9d2-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-33fd2897-636a-4a35-a611-e249073ed9d2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-33fd2897-636a-4a35-a611-e249073ed9d2" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-33fd2897-636a-4a35-a611-e249073ed9d2" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2973d8b-f6c4-4f35-8bc5-4e21b2a636da]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:17 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 Sep 28 21:43:17 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:17 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2" returned: 0 in 0.492s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:17 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2 Sep 28 21:43:17 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:18 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-33fd2897-636a-4a35-a611-e249073ed9d2" returned: 0 in 0.284s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-33fd2897-636a-4a35-a611-e249073ed9d2" released by "delete_volume" :: held 0.852s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Created reservations ['eccfa72c-e835-446e-ae8e-0072b8f0366e', '7c960318-f086-4405-a685-7c43c05cae55', 'cf82544e-7cfa-41d7-a683-df7afbd46a9c', '3e4648de-3864-4d8c-83d2-fe5b43c4aa73'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:18 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:43:18 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-9f40abdd-4dfd-446f-82e7-2c652c699ddf-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-9f40abdd-4dfd-446f-82e7-2c652c699ddf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-8e1a4f96-d97f-49f0-923a-2756bec96e9d" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-8e1a4f96-d97f-49f0-923a-2756bec96e9d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-9f40abdd-4dfd-446f-82e7-2c652c699ddf" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-9f40abdd-4dfd-446f-82e7-2c652c699ddf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Deleting offline snapshot 9f40abdd-4dfd-446f-82e7-2c652c699ddf of volume 8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] snapshot_file for this snap is: volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:43:18 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.396s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a2b5d3-ec19-47b6-948b-003095eae861]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:18 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Deleted volume successfully. Sep 28 21:43:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-efce2938-1bfc-494a-b078-daf480826545 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-33fd2897-636a-4a35-a611-e249073ed9d2-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:19 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf Sep 28 21:43:19 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:19 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf" returned: 0 in 0.490s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:43:19 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69e3cbe-4431-4e92-a7d7-b29bb792800e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:19 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d Sep 28 21:43:19 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:20 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d" returned: 0 in 0.735s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:20 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf Sep 28 21:43:20 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:20 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf" returned: 0 in 0.579s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:20 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf Sep 28 21:43:20 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:21 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d.9f40abdd-4dfd-446f-82e7-2c652c699ddf" returned: 0 in 0.421s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-9f40abdd-4dfd-446f-82e7-2c652c699ddf" released by "_delete_snapshot" :: held 2.400s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-8e1a4f96-d97f-49f0-923a-2756bec96e9d" released by "delete_snapshot" :: held 2.430s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Created reservations ['abb6a7a8-3d72-4ac2-8e01-5cf0972c8f28', 'df25cd00-c923-4018-8222-48afd2ec0351', '45e83a16-8625-4a35-a5dd-4469654541c9', 'c0a8a9fe-bdb4-4b52-aa4b-d93891a39b5d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:21 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Delete snapshot completed successfully. Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-04b6f03b-27c4-4fb4-af5c-0c6024f4bf51 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-9f40abdd-4dfd-446f-82e7-2c652c699ddf-delete_snapshot" released by "delete_snapshot" :: held 2.662s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Flow 'volume_create_manager' (766de88b-cb64-49df-88fd-907bcd7f90d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77468636-d3cb-4031-9ab7-22d4b02a8ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77468636-d3cb-4031-9ab7-22d4b02a8ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1451131529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bdceb0-bb14-4648-ac30-404763809842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86a959691d9476dad77d6be6e16d644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:22Z,use_quota=True,user_id='c922803d61fa49b28f50e013f2d13b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51df379-ebda-45c6-b9b9-301d01e0dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51df379-ebda-45c6-b9b9-301d01e0dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3577b88c-0574-4256-b090-53c739592b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3577b88c-0574-4256-b090-53c739592b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bdceb0-bb14-4648-ac30-404763809842', 'volume_name': 'volume-62bdceb0-bb14-4648-ac30-404763809842', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acaf56f-8695-44f1-bccd-1f8c3ab925ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acaf56f-8695-44f1-bccd-1f8c3ab925ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb591fb-8072-4bfd-a139-8254223a4897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Volume 62bdceb0-bb14-4648-ac30-404763809842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bdceb0-bb14-4648-ac30-404763809842', 'volume_size': 1} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1451131529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bdceb0-bb14-4648-ac30-404763809842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86a959691d9476dad77d6be6e16d644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:22Z,use_quota=True,user_id='c922803d61fa49b28f50e013f2d13b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Creating volume 62bdceb0-bb14-4648-ac30-404763809842 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:43:21 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:43:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:21 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 1073741824 Sep 28 21:43:21 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-8e1a4f96-d97f-49f0-923a-2756bec96e9d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-8e1a4f96-d97f-49f0-923a-2756bec96e9d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-8e1a4f96-d97f-49f0-923a-2756bec96e9d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-8e1a4f96-d97f-49f0-923a-2756bec96e9d" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac5ce1b-2e22-4807-8e67-5b466eabb02a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:22 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d Sep 28 21:43:22 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:22 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 1073741824" returned: 0 in 0.681s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:22 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 Sep 28 21:43:22 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:22 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d" returned: 0 in 0.534s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:22 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d Sep 28 21:43:22 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:23 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb591fb-8072-4bfd-a139-8254223a4897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bdceb0-bb14-4648-ac30-404763809842', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25537e07-b00f-40c9-a621-b062e15827bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:23 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Volume volume-62bdceb0-bb14-4648-ac30-404763809842 (62bdceb0-bb14-4648-ac30-404763809842): created successfully Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25537e07-b00f-40c9-a621-b062e15827bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Flow 'volume_create_manager' (766de88b-cb64-49df-88fd-907bcd7f90d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8785e097-068b-4b37-84a1-6c886698aede tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Created volume successfully. Sep 28 21:43:23 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8e1a4f96-d97f-49f0-923a-2756bec96e9d" returned: 0 in 0.366s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-8e1a4f96-d97f-49f0-923a-2756bec96e9d" released by "delete_volume" :: held 1.036s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Created reservations ['24126004-2be3-4f5c-a4e2-58ac36224900', '0335e744-b423-4a01-9c28-d5fecab22304', '81d4ca66-7859-4b67-b165-ffa88db10471', 'baa2493e-c03f-4691-a7c0-ebebd15a67de'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:23 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:43:23 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:23 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.355s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:43:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Deleted volume successfully. Sep 28 21:43:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f391df48-943f-4396-9dae-ff4894f34fe7 tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-8e1a4f96-d97f-49f0-923a-2756bec96e9d-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Creating offline snapshot 7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 of volume 62bdceb0-bb14-4648-ac30-404763809842 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb52287b-4a5c-448b-a6dd-8a48670b34cd]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:24 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 Sep 28 21:43:24 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-6d373c53-3f4f-4108-a7be-320383a6f7ab-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-6d373c53-3f4f-4108-a7be-320383a6f7ab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "cinder-quobyte-6d373c53-3f4f-4108-a7be-320383a6f7ab" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-6d373c53-3f4f-4108-a7be-320383a6f7ab" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9231729a-01ac-4f07-9bbb-83eb04252be4]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:25 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab Sep 28 21:43:25 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:25 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842" returned: 0 in 0.735s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:25 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 1G Sep 28 21:43:25 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:25 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab" returned: 0 in 0.485s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:25 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab Sep 28 21:43:25 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:25 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6d373c53-3f4f-4108-a7be-320383a6f7ab" returned: 0 in 0.376s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-quobyte-6d373c53-3f4f-4108-a7be-320383a6f7ab" released by "delete_volume" :: held 0.985s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:25 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 1G" returned: 0 in 0.673s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bdceb0-bb14-4648-ac30-404763809842 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Created reservations ['7c51eefb-3ddb-449c-870c-7efae093f425', 'a95f4f6b-43e0-4996-b321-bf210e7e99ab', 'd1bce8ce-0bf4-44c1-a5ff-d409635ee3bd', 'badebc1a-d060-41b9-b442-0ac268e9227e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:25 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bdceb0-bb14-4648-ac30-404763809842 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 Sep 28 21:43:25 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:25 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:43:25 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:26 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.311s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:43:26 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Deleted volume successfully. Sep 28 21:43:26 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bdceb0-bb14-4648-ac30-404763809842 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9" returned: 0 in 0.470s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:26 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 is being set with open permissions: ugo+rw Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76197e17-7696-4b30-92c9-c6b505d20f2c tempest-VolumesSnapshotTestJSON-542291037 None] Lock "cinder-6d373c53-3f4f-4108-a7be-320383a6f7ab-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:26 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 Sep 28 21:43:26 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:26 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9" returned: 0 in 0.294s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:26 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.info Sep 28 21:43:26 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:26 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.info" returned: 0 in 0.300s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:26 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.info is being set with open permissions: ugo+rw Sep 28 21:43:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:26 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.info Sep 28 21:43:26 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:27 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.info" returned: 0 in 0.317s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-04782a7a-1e1b-4d85-8f8a-e33b9b958aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Create snapshot completed successfully Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "cinder-7e6dac87-0ec3-47fa-804b-d53ea23c0eb9-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-7e6dac87-0ec3-47fa-804b-d53ea23c0eb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "cinder-quobyte-62bdceb0-bb14-4648-ac30-404763809842" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-quobyte-62bdceb0-bb14-4648-ac30-404763809842" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "cinder-quobyte-7e6dac87-0ec3-47fa-804b-d53ea23c0eb9" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-quobyte-7e6dac87-0ec3-47fa-804b-d53ea23c0eb9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Deleting offline snapshot 7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 of volume 62bdceb0-bb14-4648-ac30-404763809842 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] snapshot_file for this snap is: volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a74ec2-80bf-42f0-8fdb-f69ac838595a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:28 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 Sep 28 21:43:28 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:28 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9" returned: 0 in 0.468s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62bdceb0-bb14-4648-ac30-404763809842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7188f3c6-06ba-42d2-be5c-47d6d5ad886a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:28 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 Sep 28 21:43:28 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Flow 'volume_create_manager' (b2856b0c-e2b2-4d22-a602-fd561430f85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05d4bef-6e4f-438b-b5db-9af7a74ef2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05d4bef-6e4f-438b-b5db-9af7a74ef2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2043341659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41257130-60ea-4349-bc39-701878b3c38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298c8245ae9e45459bf85aad3d6bba59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:29Z,use_quota=True,user_id='967edd9b443e441f8eccefd3b326f767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7253483b-d186-42dd-8b64-401f192cc0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7253483b-d186-42dd-8b64-401f192cc0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d380d68-c068-42df-bf3e-d74a731c8bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:43:29 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842" returned: 0 in 0.647s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:29 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 Sep 28 21:43:29 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d380d68-c068-42df-bf3e-d74a731c8bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41257130-60ea-4349-bc39-701878b3c38e', 'volume_name': 'volume-41257130-60ea-4349-bc39-701878b3c38e', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c052d4b8-18a0-4bed-a79c-4b18670808d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c052d4b8-18a0-4bed-a79c-4b18670808d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2858b7f3-1d69-4d1a-8b9b-99b895a1ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:29 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Volume 41257130-60ea-4349-bc39-701878b3c38e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41257130-60ea-4349-bc39-701878b3c38e', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 21:43:29 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Trying to clone 41257130-60ea-4349-bc39-701878b3c38e from image 3995c6d3-b961-4789-8642-3546544acbf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:43:29 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9" returned: 0 in 0.598s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:30 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9 Sep 28 21:43:30 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:30 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842.7e6dac87-0ec3-47fa-804b-d53ea23c0eb9" returned: 0 in 0.424s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:43:30 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Image download 20.69 MB at 20.69 MB/s Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-quobyte-7e6dac87-0ec3-47fa-804b-d53ea23c0eb9" released by "_delete_snapshot" :: held 2.414s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-quobyte-62bdceb0-bb14-4648-ac30-404763809842" released by "delete_snapshot" :: held 2.451s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acee804-a86b-4057-9777-a91f1ea6f7cc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Created reservations ['5eff2128-13ec-4e08-b8e2-b7470d49812d', '0e66862b-1fa4-4f79-a2cb-18d703a8623a', '248df494-d5ac-4ae3-80b1-e2c1017a4d34', 'fb801c79-59a2-4ded-8f72-84e5088f8c4c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Delete snapshot completed successfully. Sep 28 21:43:30 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD Sep 28 21:43:30 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9eb7b49e-55bf-4739-9cc2-3f4b83e9fab9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-7e6dac87-0ec3-47fa-804b-d53ea23c0eb9-delete_snapshot" released by "delete_snapshot" :: held 2.663s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:30 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:30 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 is fetched for user 967edd9b443e441f8eccefd3b326f767. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7f7a34-a6eb-4900-a4ff-5928397a9da5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:31 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD Sep 28 21:43:31 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:31 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2043341659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41257130-60ea-4349-bc39-701878b3c38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298c8245ae9e45459bf85aad3d6bba59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:29Z,use_quota=True,user_id='967edd9b443e441f8eccefd3b326f767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Creating volume 41257130-60ea-4349-bc39-701878b3c38e {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:43:31 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:31 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e 1073741824 Sep 28 21:43:31 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "cinder-62bdceb0-bb14-4648-ac30-404763809842-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-62bdceb0-bb14-4648-ac30-404763809842-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "cinder-quobyte-62bdceb0-bb14-4648-ac30-404763809842" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-quobyte-62bdceb0-bb14-4648-ac30-404763809842" acquired by "delete_volume" :: waited 0.039s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bc16c2-6b0e-4555-bba8-c66cd513e3f0]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:32 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 Sep 28 21:43:32 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:32 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e 1073741824" returned: 0 in 0.822s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:32 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e Sep 28 21:43:32 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:32 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842" returned: 0 in 0.710s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:32 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842 Sep 28 21:43:32 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:32 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e" returned: 0 in 0.402s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Attempting download of 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume 41257130-60ea-4349-bc39-701878b3c38e. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4777a8-aa0d-4dda-af43-eefda693afa0]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_k2fv6nff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:33 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_k2fv6nff Sep 28 21:43:33 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:33 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-62bdceb0-bb14-4648-ac30-404763809842" returned: 0 in 0.721s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:33 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_k2fv6nff" returned: 0 in 0.426s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_k2fv6nff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-quobyte-62bdceb0-bb14-4648-ac30-404763809842" released by "delete_volume" :: held 1.627s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Created reservations ['6c9cdc72-573c-44ec-ad1a-34a318a280b2', 'bb01ddb5-da47-413b-b558-5e029cf79ee8', '5be25ca9-bd22-45a3-8189-1f5beeb07fca', '0c394099-b9c2-47af-818a-f6438ec3e0cc'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:33 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_k2fv6nff Sep 28 21:43:33 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:33 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:43:33 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:34 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_k2fv6nff" returned: 1 in 0.668s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3995c6d3-b961-4789-8642-3546544acbf3_k2fv6nff' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3e5733-263c-4311-8fd6-960091ee144b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:34 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.382s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:43:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Deleted volume successfully. Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5ab6abc5-46ce-495f-a67a-e94c2de45e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1449673320 None] Lock "cinder-62bdceb0-bb14-4648-ac30-404763809842-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:34 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD Sep 28 21:43:34 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:34 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] 3995c6d3-b961-4789-8642-3546544acbf3 was qcow2, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:43:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:34 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e Sep 28 21:43:34 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:37 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e" returned: 0 in 3.127s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:37 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3995c6d3-b961-4789-8642-3546544acbf3_wqafm7yodevstack@QuobyteHD, size 112.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:43:37 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Converted 112.00 MB image at 35.80 MB/s Sep 28 21:43:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:37 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e 1G Sep 28 21:43:37 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:38 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e 1G" returned: 0 in 0.500s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Downloaded image 3995c6d3-b961-4789-8642-3546544acbf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}])) to volume 41257130-60ea-4349-bc39-701878b3c38e successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Temporary image 3995c6d3-b961-4789-8642-3546544acbf3 for user 967edd9b443e441f8eccefd3b326f767 is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Marking volume 41257130-60ea-4349-bc39-701878b3c38e as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Copying metadata from image 3995c6d3-b961-4789-8642-3546544acbf3 to 41257130-60ea-4349-bc39-701878b3c38e. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Creating volume glance metadata for volume 41257130-60ea-4349-bc39-701878b3c38e backed by image 3995c6d3-b961-4789-8642-3546544acbf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2858b7f3-1d69-4d1a-8b9b-99b895a1ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41257130-60ea-4349-bc39-701878b3c38e', 'volume_size': 1, 'image_id': '3995c6d3-b961-4789-8642-3546544acbf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3995c6d3-b961-4789-8642-3546544acbf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4837b5a5eaa6498ca6790fd06713aab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3995c6d3-b961-4789-8642-3546544acbf3', 'created_at': datetime.datetime(2026, 9, 28, 19, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3995c6d3-b961-4789-8642-3546544acbf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e933311-4622-4c4e-810e-d41307ce55be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:38 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Volume volume-41257130-60ea-4349-bc39-701878b3c38e (41257130-60ea-4349-bc39-701878b3c38e): created successfully Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e933311-4622-4c4e-810e-d41307ce55be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Flow 'volume_create_manager' (b2856b0c-e2b2-4d22-a602-fd561430f85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fa8a0d09-e98f-4d90-bbee-f24e46cb027f tempest-TestShelveInstance-1369226075 None] Created volume successfully. Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Flow 'volume_create_manager' (89caac08-3ea1-4f31-b5cd-80a16a9754fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3221cf09-8a96-4ecc-8c9c-ee1e34fcc02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3221cf09-8a96-4ecc-8c9c-ee1e34fcc02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1705622634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7b0108-b3c5-4788-b72e-05c0c96a27b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747156a148ba41aa8d28e367f3d21d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:40Z,use_quota=True,user_id='a5ec76888b7941e4b228fd453ea06fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c7a959-47d9-4351-9c3b-2d11ba264055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c7a959-47d9-4351-9c3b-2d11ba264055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb587d53-40e3-487a-81c0-ee87c073ce34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb587d53-40e3-487a-81c0-ee87c073ce34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7b0108-b3c5-4788-b72e-05c0c96a27b7', 'volume_name': 'volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7', 'volume_size': 2}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f508abc-2c18-4970-91ea-9799e86d5c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f508abc-2c18-4970-91ea-9799e86d5c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35b1e4e-37b0-450e-aea6-bbef4e13b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:40 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Volume bd7b0108-b3c5-4788-b72e-05c0c96a27b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7', 'volume_size': 2} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1705622634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7b0108-b3c5-4788-b72e-05c0c96a27b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747156a148ba41aa8d28e367f3d21d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:40Z,use_quota=True,user_id='a5ec76888b7941e4b228fd453ea06fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Creating volume bd7b0108-b3c5-4788-b72e-05c0c96a27b7 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:43:40 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 2147483648 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:40 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 2147483648 Sep 28 21:43:40 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:40 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 2147483648" returned: 0 in 0.682s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:41 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 Sep 28 21:43:41 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:41 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" returned: 0 in 0.400s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:43:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35b1e4e-37b0-450e-aea6-bbef4e13b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7', 'volume_size': 2}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cb72c9-4c03-4eac-ad1a-a68f59d453ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:41 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Volume volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 (bd7b0108-b3c5-4788-b72e-05c0c96a27b7): created successfully Sep 28 21:43:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cb72c9-4c03-4eac-ad1a-a68f59d453ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Flow 'volume_create_manager' (89caac08-3ea1-4f31-b5cd-80a16a9754fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:41 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2aa1bf9a-27d8-4bda-87bf-6e0cbb219ffe tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Created volume successfully. Sep 28 21:43:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Creating offline snapshot 201b2eeb-20d3-4383-855d-f88ce8d9c6ec of volume bd7b0108-b3c5-4788-b72e-05c0c96a27b7 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:43:42 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce5841d-cc59-48fb-a5d1-d32f0e67a643]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:42 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 Sep 28 21:43:42 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:42 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Flow 'volume_create_manager' (6c5f4c96-d242-451e-b1bf-7227a2d751ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea0a42c-c0e0-462c-9f47-c7c6412e22a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea0a42c-c0e0-462c-9f47-c7c6412e22a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-155578076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6673eda0-2f13-4937-8355-4942d77bf23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1252973396bc4e4aa27b2bf02b53ece5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:43Z,use_quota=True,user_id='d801a07d489144e6bbfa5dcec66300c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b947e0f5-9731-4b1f-85cd-547c94ae9168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b947e0f5-9731-4b1f-85cd-547c94ae9168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686a2444-4e19-4164-afea-8cde7afbddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686a2444-4e19-4164-afea-8cde7afbddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6673eda0-2f13-4937-8355-4942d77bf23d', 'volume_name': 'volume-6673eda0-2f13-4937-8355-4942d77bf23d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7033a248-9a66-402b-a972-6509d2653a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7033a248-9a66-402b-a972-6509d2653a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5629a19e-b495-4d49-abbb-0181629f7086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:43 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Volume 6673eda0-2f13-4937-8355-4942d77bf23d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6673eda0-2f13-4937-8355-4942d77bf23d', 'volume_size': 1} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-8ad3697b-8473-45a3-b8cd-2d131938159f req-e268a0c1-f2a9-450c-b2ef-cb1b6435d701 tempest-TestShelveInstance-1369226075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:43 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" returned: 0 in 0.716s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec 2G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:43 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec 2G Sep 28 21:43:43 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:43 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec 2G" returned: 0 in 0.650s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:43 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec Sep 28 21:43:43 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:44 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec" returned: 0 in 0.363s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:44 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec is being set with open permissions: ugo+rw Sep 28 21:43:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:44 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec Sep 28 21:43:44 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:44 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec" returned: 0 in 0.370s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:44 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.info Sep 28 21:43:44 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:44 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.info" returned: 0 in 0.261s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:44 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.info is being set with open permissions: ugo+rw Sep 28 21:43:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:44 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.info Sep 28 21:43:44 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:45 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.info" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.154s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-155578076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6673eda0-2f13-4937-8355-4942d77bf23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1252973396bc4e4aa27b2bf02b53ece5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:43Z,use_quota=True,user_id='d801a07d489144e6bbfa5dcec66300c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Creating volume 6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:43:45 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:45 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d 1073741824 Sep 28 21:43:45 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:45 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-61296280-3326-478e-af45-cbac782c0a84 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Create snapshot completed successfully Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "cinder-201b2eeb-20d3-4383-855d-f88ce8d9c6ec-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-201b2eeb-20d3-4383-855d-f88ce8d9c6ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "cinder-quobyte-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-quobyte-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "cinder-quobyte-201b2eeb-20d3-4383-855d-f88ce8d9c6ec" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-quobyte-201b2eeb-20d3-4383-855d-f88ce8d9c6ec" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Deleting offline snapshot 201b2eeb-20d3-4383-855d-f88ce8d9c6ec of volume bd7b0108-b3c5-4788-b72e-05c0c96a27b7 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] snapshot_file for this snap is: volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be6a9a-0aff-42a4-b42d-88707797d4eb]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:45 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d 1073741824" returned: 0 in 0.597s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:45 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d Sep 28 21:43:45 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:45 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec Sep 28 21:43:45 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:46 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d" returned: 0 in 0.276s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-8ad3697b-8473-45a3-b8cd-2d131938159f req-e268a0c1-f2a9-450c-b2ef-cb1b6435d701 tempest-TestShelveInstance-1369226075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.023s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5629a19e-b495-4d49-abbb-0181629f7086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6673eda0-2f13-4937-8355-4942d77bf23d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf3621a-d7a8-4a5b-915d-913e6a36ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-8ad3697b-8473-45a3-b8cd-2d131938159f req-e268a0c1-f2a9-450c-b2ef-cb1b6435d701 tempest-TestShelveInstance-1369226075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:46 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Volume volume-6673eda0-2f13-4937-8355-4942d77bf23d (6673eda0-2f13-4937-8355-4942d77bf23d): created successfully Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf3621a-d7a8-4a5b-915d-913e6a36ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Flow 'volume_create_manager' (6c5f4c96-d242-451e-b1bf-7227a2d751ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-36fb7606-42b5-4226-a129-1ad734a8591c tempest-VolumesCloneTest-1931942307 None] Created volume successfully. Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-8ad3697b-8473-45a3-b8cd-2d131938159f req-e268a0c1-f2a9-450c-b2ef-cb1b6435d701 tempest-TestShelveInstance-1369226075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-41257130-60ea-4349-bc39-701878b3c38e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddf09634-ed9d-4f40-af71-49104fba3c1c', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:43:46 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec" returned: 0 in 0.440s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d20017-59f0-4590-b920-69603af673a1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-8ad3697b-8473-45a3-b8cd-2d131938159f req-e268a0c1-f2a9-450c-b2ef-cb1b6435d701 tempest-TestShelveInstance-1369226075 None] attachment_update completed successfully. Sep 28 21:43:46 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 Sep 28 21:43:46 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:46 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" returned: 0 in 0.404s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:46 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec Sep 28 21:43:46 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:47 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec" returned: 0 in 0.707s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:47 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec Sep 28 21:43:47 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:47 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:43:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Flow 'volume_create_manager' (b63eaa70-36d1-4254-8093-ffe0b21a0ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:43:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ae96ea-ecab-456a-bdf5-e1a9c4517eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:48 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7.201b2eeb-20d3-4383-855d-f88ce8d9c6ec" returned: 0 in 0.568s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ae96ea-ecab-456a-bdf5-e1a9c4517eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-981009793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510f4d10-e58d-4a3f-9cd1-e86798c947e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1252973396bc4e4aa27b2bf02b53ece5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:43:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6673eda0-2f13-4937-8355-4942d77bf23d,status='creating',terminated_at=None,updated_at=2026-09-28T19:43:48Z,use_quota=True,user_id='d801a07d489144e6bbfa5dcec66300c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef2edb2-2068-4a8a-adbe-1be3050cd6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef2edb2-2068-4a8a-adbe-1be3050cd6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed48c4e-63da-4834-a3fe-5b036a4f1ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed48c4e-63da-4834-a3fe-5b036a4f1ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '510f4d10-e58d-4a3f-9cd1-e86798c947e1', 'volume_name': 'volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1', 'volume_size': 2, 'source_volid': '6673eda0-2f13-4937-8355-4942d77bf23d', 'source_volstatus': 'available'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa14969-4fcb-4a0c-a760-38535cd1270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa14969-4fcb-4a0c-a760-38535cd1270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ec96f1-e312-494d-bc91-d0764c3694dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:43:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Volume 510f4d10-e58d-4a3f-9cd1-e86798c947e1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1', 'volume_size': 2, 'source_volid': '6673eda0-2f13-4937-8355-4942d77bf23d', 'source_volstatus': 'available'} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-quobyte-201b2eeb-20d3-4383-855d-f88ce8d9c6ec" released by "_delete_snapshot" :: held 2.331s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:48 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Cloning volume 6673eda0-2f13-4937-8355-4942d77bf23d to volume 510f4d10-e58d-4a3f-9cd1-e86798c947e1 Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-quobyte-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" released by "delete_snapshot" :: held 2.376s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Creating offline snapshot 7e9fe185-4d28-4abb-a9f9-aac415bc2752 of volume 6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285a650-c93a-44e5-b4b2-6342c620f25a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Created reservations ['9dbbb8a4-5763-477d-80c2-a582064d7c6a', '3f8a4bf0-2a2b-414d-bde4-446ebf163f90', '282859e1-3dab-4f36-b77f-a174c1c660e4', '9488baef-8df0-48d4-8697-9c5fa6c04f63'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:48 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d Sep 28 21:43:48 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Delete snapshot completed successfully. Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-95fd76e4-ae90-4d5f-98a1-062ba0c25b1e tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-201b2eeb-20d3-4383-855d-f88ce8d9c6ec-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:48 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d" returned: 0 in 0.427s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:48 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 1G Sep 28 21:43:48 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "cinder-bd7b0108-b3c5-4788-b72e-05c0c96a27b7-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-bd7b0108-b3c5-4788-b72e-05c0c96a27b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "cinder-quobyte-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-quobyte-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:49 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 1G" returned: 0 in 0.569s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6673eda0-2f13-4937-8355-4942d77bf23d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec7d104-9888-435c-a9b9-42596e1a2a7f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:49 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6673eda0-2f13-4937-8355-4942d77bf23d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 Sep 28 21:43:49 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:49 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 Sep 28 21:43:49 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:49 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6673eda0-2f13-4937-8355-4942d77bf23d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752" returned: 0 in 0.348s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:49 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 is being set with open permissions: ugo+rw Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:49 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 Sep 28 21:43:49 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:49 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" returned: 0 in 0.405s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:49 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7 Sep 28 21:43:49 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:49 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752" returned: 0 in 0.360s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=109,cinder:INSERT=36,cinder:UPDATE=115,cinder:DELETE=7 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=115,cinder:UPDATE=116,cinder:DELETE=12,cinder:INSERT=34 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:43:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:49 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" returned: 0 in 0.417s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:50 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.info Sep 28 21:43:50 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-quobyte-bd7b0108-b3c5-4788-b72e-05c0c96a27b7" released by "delete_volume" :: held 0.938s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Created reservations ['6fb13171-360f-479b-9a42-3510bda9e2c5', 'b3774632-a2a4-4ea6-9c1c-71c7a879cd53', '71a3674e-2c97-457c-a655-7d981edc5329', 'a50141b3-d94f-4cb5-8d13-a5c6b8135a35'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:43:50 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.info" returned: 0 in 0.363s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:50 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.info is being set with open permissions: ugo+rw Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:50 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.info Sep 28 21:43:50 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:50 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:43:50 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:50 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.info" returned: 0 in 0.272s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "cinder-quobyte-510f4d10-e58d-4a3f-9cd1-e86798c947e1" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-quobyte-510f4d10-e58d-4a3f-9cd1-e86798c947e1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] snapshot: 7e9fe185-4d28-4abb-a9f9-aac415bc2752, volume: 510f4d10-e58d-4a3f-9cd1-e86798c947e1, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:43:50 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[741641c7-3a20-4125-aa33-695423501ff7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.315s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:43:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Deleted volume successfully. Sep 28 21:43:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a3e967f8-395b-4644-a86f-3def15a963b0 tempest-VolumesSnapshotNegativeTestJSON-667247487 None] Lock "cinder-bd7b0108-b3c5-4788-b72e-05c0c96a27b7-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:43:50 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 Sep 28 21:43:50 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:51 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752" returned: 0 in 0.478s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6673eda0-2f13-4937-8355-4942d77bf23d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7247784-d6ec-4937-a987-9fd883569e06]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:51 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d Sep 28 21:43:51 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:43:51 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d" returned: 0 in 0.749s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:43:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:43:52 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 Sep 28 21:43:52 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:00 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=5,cinder:INSERT=5,cinder:UPDATE=9 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:44:00 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:44:05 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1" returned: 0 in 13.483s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d, size 1024.00 MB, duration 13.49 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:44:05 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Converted 1024.00 MB image at 75.93 MB/s Sep 28 21:44:05 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 is being set with open permissions: ugo+rw Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:05 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 Sep 28 21:44:05 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:05 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1" returned: 0 in 0.386s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-quobyte-510f4d10-e58d-4a3f-9cd1-e86798c947e1" released by "_copy_volume_from_snapshot" :: held 15.199s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "cinder-quobyte-7e9fe185-4d28-4abb-a9f9-aac415bc2752" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-quobyte-7e9fe185-4d28-4abb-a9f9-aac415bc2752" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Deleting offline snapshot 7e9fe185-4d28-4abb-a9f9-aac415bc2752 of volume 6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] snapshot_file for this snap is: volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e26191e-dd65-4838-9078-65c78729bcc5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:44:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:06 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 Sep 28 21:44:06 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:06 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752" returned: 0 in 0.468s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6673eda0-2f13-4937-8355-4942d77bf23d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:44:06 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2919d481-2c1c-49ea-8760-2bb1e146b990]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:44:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:06 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d Sep 28 21:44:06 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:07 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d" returned: 0 in 0.740s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:07 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 Sep 28 21:44:07 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:07 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:44:07 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:07 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752" returned: 0 in 0.537s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:07 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.338s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:44:07 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752 Sep 28 21:44:07 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 28 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:44:07 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-0e8b90c1-b1b3-4c42-861b-04a4fb15ed2e req-89419ea1-8d2f-4a93-b422-6d491983ab1c tempest-AttachVolumeNegativeTest-2091995112 None] Terminate volume connection completed successfully. Sep 28 21:44:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-0e8b90c1-b1b3-4c42-861b-04a4fb15ed2e req-89419ea1-8d2f-4a93-b422-6d491983ab1c tempest-AttachVolumeNegativeTest-2091995112 None] Deleting attachment 7dac6789-4320-4caa-9778-b4631cff88b5. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:44:08 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d.7e9fe185-4d28-4abb-a9f9-aac415bc2752" returned: 0 in 0.358s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-quobyte-7e9fe185-4d28-4abb-a9f9-aac415bc2752" released by "_delete_snapshot" :: held 2.289s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:44:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.157s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ec96f1-e312-494d-bc91-d0764c3694dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1', 'volume_size': 2, 'source_volid': '6673eda0-2f13-4937-8355-4942d77bf23d', 'source_volstatus': 'available'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584c349b-fb20-4ae3-af40-4f10ed5d3a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:08 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Volume volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 (510f4d10-e58d-4a3f-9cd1-e86798c947e1): created successfully Sep 28 21:44:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584c349b-fb20-4ae3-af40-4f10ed5d3a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Flow 'volume_create_manager' (b63eaa70-36d1-4254-8093-ffe0b21a0ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:44:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-66f36c1e-01f6-4832-965c-980ed995ff72 tempest-VolumesCloneTest-1931942307 None] Created volume successfully. Sep 28 21:44:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "cinder-510f4d10-e58d-4a3f-9cd1-e86798c947e1-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:44:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-510f4d10-e58d-4a3f-9cd1-e86798c947e1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:44:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "cinder-quobyte-510f4d10-e58d-4a3f-9cd1-e86798c947e1" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:44:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-quobyte-510f4d10-e58d-4a3f-9cd1-e86798c947e1" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:44:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4e972a-ff53-4c28-8985-b42ea94f1e47]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:44:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:09 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 Sep 28 21:44:09 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:10 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1" returned: 0 in 0.515s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:10 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1 Sep 28 21:44:10 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:10 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-510f4d10-e58d-4a3f-9cd1-e86798c947e1" returned: 0 in 0.309s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-quobyte-510f4d10-e58d-4a3f-9cd1-e86798c947e1" released by "delete_volume" :: held 0.885s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Created reservations ['c0ccb27a-0b03-471c-9ea9-c1432356d976', 'ce3567a8-6dac-4d90-be16-11e67538a863', '806c955c-3969-42df-b585-a2e8c03e5e7a', '1c726f94-cccb-4adb-a610-fc209fbbf8cb'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:10 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:44:10 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:11 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:44:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Deleted volume successfully. Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0388df99-e1cc-4555-a29a-499bfa107804 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-510f4d10-e58d-4a3f-9cd1-e86798c947e1-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "cinder-6673eda0-2f13-4937-8355-4942d77bf23d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-6673eda0-2f13-4937-8355-4942d77bf23d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "cinder-quobyte-6673eda0-2f13-4937-8355-4942d77bf23d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-quobyte-6673eda0-2f13-4937-8355-4942d77bf23d" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[51363dba-25a6-4f54-ae63-f6a84619f3ca]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:11 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d Sep 28 21:44:11 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:11 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d" returned: 0 in 0.384s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:11 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d Sep 28 21:44:11 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:12 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6673eda0-2f13-4937-8355-4942d77bf23d" returned: 0 in 0.387s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-quobyte-6673eda0-2f13-4937-8355-4942d77bf23d" released by "delete_volume" :: held 0.879s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Created reservations ['e1810339-e095-477b-9fed-784e036111cb', '165f57af-059c-4c69-bdd5-c9528da8b32f', 'daa08705-d4ee-4b00-aebc-f2958a2415a7', '3dbd48be-ec44-4a57-937f-8c8f6141450b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:12 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:44:12 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:12 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.361s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:44:12 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Deleted volume successfully. Sep 28 21:44:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-412187aa-1814-4dea-9e10-ee3938cd85e8 tempest-VolumesCloneTest-1931942307 None] Lock "cinder-6673eda0-2f13-4937-8355-4942d77bf23d-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Flow 'volume_create_manager' (f85df352-4be0-4e83-a31f-8bd6e8326dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d9f74a-f000-4cfc-8e65-9255f90793d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d9f74a-f000-4cfc-8e65-9255f90793d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-608454647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2def09-f562-40df-a1fb-8494d8d8ffda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc868ae8e92a46d9b530387e2cd2df0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:44:20Z,use_quota=True,user_id='f760b47c27ab4345bbd6e64ac62f7a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1732843-9538-40a1-8749-645f169b53ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1732843-9538-40a1-8749-645f169b53ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf8fa85-860f-47f4-8c7c-0c15cd67412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf8fa85-860f-47f4-8c7c-0c15cd67412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2def09-f562-40df-a1fb-8494d8d8ffda', 'volume_name': 'volume-8c2def09-f562-40df-a1fb-8494d8d8ffda', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3836b9bd-8c7c-4ee1-8aeb-f27d1975e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3836b9bd-8c7c-4ee1-8aeb-f27d1975e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ee4883-54e3-4238-9b30-7cc1b9cbe87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:19 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Volume 8c2def09-f562-40df-a1fb-8494d8d8ffda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2def09-f562-40df-a1fb-8494d8d8ffda', 'volume_size': 1} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-608454647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2def09-f562-40df-a1fb-8494d8d8ffda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc868ae8e92a46d9b530387e2cd2df0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:44:20Z,use_quota=True,user_id='f760b47c27ab4345bbd6e64ac62f7a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Creating volume 8c2def09-f562-40df-a1fb-8494d8d8ffda {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:44:19 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:44:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:19 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda 1073741824 Sep 28 21:44:19 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:20 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda 1073741824" returned: 0 in 0.505s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:20 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda Sep 28 21:44:20 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:20 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda" returned: 0 in 0.286s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ee4883-54e3-4238-9b30-7cc1b9cbe87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2def09-f562-40df-a1fb-8494d8d8ffda', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee7845e-403e-4f47-b8a8-9defb55629df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:20 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Volume volume-8c2def09-f562-40df-a1fb-8494d8d8ffda (8c2def09-f562-40df-a1fb-8494d8d8ffda): created successfully Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee7845e-403e-4f47-b8a8-9defb55629df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Flow 'volume_create_manager' (f85df352-4be0-4e83-a31f-8bd6e8326dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:44:20 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f11002e8-cab7-4910-ba78-326663d43dad tempest-VolumesNegativeTest-1779207443 None] Created volume successfully. Sep 28 21:44:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-111ac786-1c65-490b-83a7-287e36b9feed req-3481d7f1-9f6f-4b8f-a7c6-504717209d6a tempest-TestShelveInstance-1369226075 None] Terminate volume connection completed successfully. Sep 28 21:44:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-111ac786-1c65-490b-83a7-287e36b9feed req-3481d7f1-9f6f-4b8f-a7c6-504717209d6a tempest-TestShelveInstance-1369226075 None] Deleting attachment ddf09634-ed9d-4f40-af71-49104fba3c1c. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Flow 'volume_create_manager' (f3d72fd4-f4bd-440c-ba30-5ecb7a1da8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11da10e-f22b-4bee-b8f6-c56dbac6a599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11da10e-f22b-4bee-b8f6-c56dbac6a599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2029886966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14227d971945df89551fe57ec74d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:44:35Z,use_quota=True,user_id='d0e76acf7a044c54987fdc02f93fc8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98e8604-cd2d-4d1c-8b85-9641999b32e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98e8604-cd2d-4d1c-8b85-9641999b32e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce19551-d645-4dc7-a310-6b6b3ca70a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce19551-d645-4dc7-a310-6b6b3ca70a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9', 'volume_name': 'volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f103cc-c8fa-4ac7-99bb-4aa09964d1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f103cc-c8fa-4ac7-99bb-4aa09964d1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0eb169-643f-4fc8-86cb-1ddce64b9446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:35 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Volume 4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9', 'volume_size': 1} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2029886966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14227d971945df89551fe57ec74d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:44:35Z,use_quota=True,user_id='d0e76acf7a044c54987fdc02f93fc8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Creating volume 4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:44:35 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:35 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 1073741824 Sep 28 21:44:35 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-0634679a-353c-4db9-a09b-bb854c68df71 req-a4c7a49d-c949-4ea5-8b50-31ed586c3e45 tempest-TestShelveInstance-1369226075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:36 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 1073741824" returned: 0 in 1.267s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:36 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 Sep 28 21:44:36 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:37 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" returned: 0 in 0.436s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-0634679a-353c-4db9-a09b-bb854c68df71 req-a4c7a49d-c949-4ea5-8b50-31ed586c3e45 tempest-TestShelveInstance-1369226075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.448s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0eb169-643f-4fc8-86cb-1ddce64b9446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4b66db-ecca-471b-a6b3-52a0a972285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-0634679a-353c-4db9-a09b-bb854c68df71 req-a4c7a49d-c949-4ea5-8b50-31ed586c3e45 tempest-TestShelveInstance-1369226075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:37 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Volume volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 (4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9): created successfully Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4b66db-ecca-471b-a6b3-52a0a972285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Flow 'volume_create_manager' (f3d72fd4-f4bd-440c-ba30-5ecb7a1da8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:44:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-eaf6aa46-5d50-4bc9-a590-9f51d07696f4 tempest-TestStampPattern-1833587336 None] Created volume successfully. Sep 28 21:44:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-0634679a-353c-4db9-a09b-bb854c68df71 req-a4c7a49d-c949-4ea5-8b50-31ed586c3e45 tempest-TestShelveInstance-1369226075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-41257130-60ea-4349-bc39-701878b3c38e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8912638-e608-4919-b76e-981e5679eed1', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:44:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-0634679a-353c-4db9-a09b-bb854c68df71 req-a4c7a49d-c949-4ea5-8b50-31ed586c3e45 tempest-TestShelveInstance-1369226075 None] attachment_update completed successfully. Sep 28 21:44:47 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=28,cinder:UPDATE=25,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:44:47 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=29,cinder:SELECT=19,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:44:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Acquiring lock "cinder-8c2def09-f562-40df-a1fb-8494d8d8ffda-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:44:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Lock "cinder-8c2def09-f562-40df-a1fb-8494d8d8ffda-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:44:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Acquiring lock "cinder-quobyte-8c2def09-f562-40df-a1fb-8494d8d8ffda" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:44:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Lock "cinder-quobyte-8c2def09-f562-40df-a1fb-8494d8d8ffda" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:44:57 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb25270e-ed2d-4bd5-a7f0-f114f709c5f4]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:44:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:57 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda Sep 28 21:44:57 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:58 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda" returned: 0 in 0.659s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:58 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda Sep 28 21:44:58 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:58 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8c2def09-f562-40df-a1fb-8494d8d8ffda" returned: 0 in 0.339s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Lock "cinder-quobyte-8c2def09-f562-40df-a1fb-8494d8d8ffda" released by "delete_volume" :: held 1.071s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Created reservations ['b309ba06-7eb6-4208-a03e-6136dc46bbd1', 'd2b0e330-7dcd-45fe-abdb-1db4f4186ae7', 'd4befae9-dc8c-45ba-a257-3dfb405f282d', 'bb78b4ab-2eec-42b4-99ae-178f539ac3d6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:44:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:44:58 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:44:58 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:44:59 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 28 21:44:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.399s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:44:59 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:44:59 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Deleted volume successfully. Sep 28 21:44:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-577f4116-09ab-4fda-86ed-41d175d6caba tempest-VolumesNegativeTest-1779207443 None] Lock "cinder-8c2def09-f562-40df-a1fb-8494d8d8ffda-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Flow 'volume_create_manager' (0f5e384f-9968-4164-ab9c-accd656547d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0005057-77ca-423c-96db-6305b66ef341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0005057-77ca-423c-96db-6305b66ef341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1198841246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763377ae-4ab0-44a3-a8a3-c80323026dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30262c26c6b84af2b4e3234f0132e7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:45:01Z,use_quota=True,user_id='555537f36df0446190174d03f0ab8fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae181725-44cf-4c97-acb4-a0484360e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae181725-44cf-4c97-acb4-a0484360e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e29fa8-cc7e-4a93-a7c6-b8c16ab20924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e29fa8-cc7e-4a93-a7c6-b8c16ab20924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '763377ae-4ab0-44a3-a8a3-c80323026dd2', 'volume_name': 'volume-763377ae-4ab0-44a3-a8a3-c80323026dd2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d13b61-f77b-4d56-9585-4ced55a882bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d13b61-f77b-4d56-9585-4ced55a882bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a641fc65-cc5c-4ac3-ad72-5ba4c01feb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:01 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Volume 763377ae-4ab0-44a3-a8a3-c80323026dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-763377ae-4ab0-44a3-a8a3-c80323026dd2', 'volume_size': 1} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1198841246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763377ae-4ab0-44a3-a8a3-c80323026dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30262c26c6b84af2b4e3234f0132e7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:45:01Z,use_quota=True,user_id='555537f36df0446190174d03f0ab8fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Creating volume 763377ae-4ab0-44a3-a8a3-c80323026dd2 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:45:01 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:45:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:01 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 1073741824 Sep 28 21:45:01 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:02 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 1073741824" returned: 0 in 0.680s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:02 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 Sep 28 21:45:02 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:02 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2" returned: 0 in 0.330s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a641fc65-cc5c-4ac3-ad72-5ba4c01feb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763377ae-4ab0-44a3-a8a3-c80323026dd2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c54b0f-9d21-40e6-82ab-7dc309cdc2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:02 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Volume volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 (763377ae-4ab0-44a3-a8a3-c80323026dd2): created successfully Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c54b0f-9d21-40e6-82ab-7dc309cdc2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:02 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Flow 'volume_create_manager' (0f5e384f-9968-4164-ab9c-accd656547d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:45:02 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-25f02bf4-303a-4ebe-b4c1-d551f8226bdd tempest-AttachVolumeNegativeTest-2091995112 None] Created volume successfully. Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Flow 'volume_create_manager' (d4bb5a76-845d-4466-8d66-d9f66b8724d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b09479-9bec-43df-91f1-919ded05d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b09479-9bec-43df-91f1-919ded05d600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1866919100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a7e7bf-aa84-42a3-94d5-1301c0514373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5d33bc697b47afa8192ce4991c2347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:45:04Z,use_quota=True,user_id='a5412029572149b792da0eed5c6624af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0c72f0-e7ad-4ae5-9302-6349a6594c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0c72f0-e7ad-4ae5-9302-6349a6594c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d811fdd-5d5e-44bd-a89b-29d2e8be03eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d811fdd-5d5e-44bd-a89b-29d2e8be03eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a7e7bf-aa84-42a3-94d5-1301c0514373', 'volume_name': 'volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bae281-8985-4de8-8dc2-cf9e717ebe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bae281-8985-4de8-8dc2-cf9e717ebe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7903774-4c50-450b-a9f6-9a3844357585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:04 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Volume f1a7e7bf-aa84-42a3-94d5-1301c0514373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373', 'volume_size': 1} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1866919100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a7e7bf-aa84-42a3-94d5-1301c0514373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5d33bc697b47afa8192ce4991c2347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:45:04Z,use_quota=True,user_id='a5412029572149b792da0eed5c6624af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Creating volume f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:45:04 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:04 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 1073741824 Sep 28 21:45:04 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-fcc7b663-74e2-48dc-975f-1640c881fc7a req-4b9bd248-d802-4126-a25a-0dc49b79ca69 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:04 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 1073741824" returned: 0 in 0.451s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:05 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 Sep 28 21:45:05 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:05 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373" returned: 0 in 0.285s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-fcc7b663-74e2-48dc-975f-1640c881fc7a req-4b9bd248-d802-4126-a25a-0dc49b79ca69 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.717s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7903774-4c50-450b-a9f6-9a3844357585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4381d93-a009-4f5d-b3ae-26c5559f0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-fcc7b663-74e2-48dc-975f-1640c881fc7a req-4b9bd248-d802-4126-a25a-0dc49b79ca69 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:05 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Volume volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 (f1a7e7bf-aa84-42a3-94d5-1301c0514373): created successfully Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4381d93-a009-4f5d-b3ae-26c5559f0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Flow 'volume_create_manager' (d4bb5a76-845d-4466-8d66-d9f66b8724d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:45:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-809565a1-2289-4524-b7e4-508d010cba13 tempest-VolumesSnapshotListTestJSON-1240480628 None] Created volume successfully. Sep 28 21:45:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-fcc7b663-74e2-48dc-975f-1640c881fc7a req-4b9bd248-d802-4126-a25a-0dc49b79ca69 tempest-AttachVolumeNegativeTest-2091995112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-763377ae-4ab0-44a3-a8a3-c80323026dd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cb21190-e0f5-4cc0-a48b-46817e141b50', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:45:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-fcc7b663-74e2-48dc-975f-1640c881fc7a req-4b9bd248-d802-4126-a25a-0dc49b79ca69 tempest-AttachVolumeNegativeTest-2091995112 None] attachment_update completed successfully. Sep 28 21:45:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Creating offline snapshot 1146c062-9f71-46c2-9ea3-4d0d1ee0d091 of volume f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:45:06 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[52129859-3511-4cd3-adc7-9bddf9e4c3f7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:06 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 Sep 28 21:45:06 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:07 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373" returned: 0 in 0.581s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:07 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 1G Sep 28 21:45:07 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:07 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:45:07 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:07 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.289s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:45:07 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-0d86eea9-7015-48f2-9ae1-e565689cdc51 req-1b3741da-dbc4-4d22-975d-898df79e8fb4 tempest-AttachVolumeNegativeTest-2091995112 None] Terminate volume connection completed successfully. Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-0d86eea9-7015-48f2-9ae1-e565689cdc51 req-1b3741da-dbc4-4d22-975d-898df79e8fb4 tempest-AttachVolumeNegativeTest-2091995112 None] Deleting attachment 0cb21190-e0f5-4cc0-a48b-46817e141b50. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 28 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:45:07 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 1G" returned: 0 in 0.491s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:07 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 Sep 28 21:45:07 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:08 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091" returned: 0 in 0.305s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:08 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 is being set with open permissions: ugo+rw Sep 28 21:45:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:08 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 Sep 28 21:45:08 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:08 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091" returned: 0 in 0.261s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:08 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.info Sep 28 21:45:08 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:08 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.info" returned: 0 in 0.307s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:08 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.info is being set with open permissions: ugo+rw Sep 28 21:45:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:08 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.info Sep 28 21:45:08 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:09 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.info" returned: 0 in 0.320s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:09 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e6fb39cf-9a44-495d-baf0-680849ff133c tempest-VolumesSnapshotListTestJSON-1240480628 None] Create snapshot completed successfully Sep 28 21:45:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Creating offline snapshot 523ea1cd-0663-441c-9bc7-bb47b0946c66 of volume f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:45:10 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee88db-6e32-4fd9-b469-055eb8c44fe8]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:10 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 Sep 28 21:45:10 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:10 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091" returned: 0 in 0.412s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:45:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:10 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 1G Sep 28 21:45:10 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:11 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 1G" returned: 0 in 0.520s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:11 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 Sep 28 21:45:11 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:11 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66" returned: 0 in 0.327s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:11 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 is being set with open permissions: ugo+rw Sep 28 21:45:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:11 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 Sep 28 21:45:11 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:11 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66" returned: 0 in 0.285s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7e8ba42d-5246-4f22-bef8-b320795ec61d tempest-VolumesSnapshotListTestJSON-1240480628 None] Create snapshot completed successfully Sep 28 21:45:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Creating offline snapshot 71fddf0a-2898-4a32-9613-a3acb6ad0fcd of volume f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:45:12 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ef5b54-acbf-493b-8616-c680692d8e98]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:12 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 Sep 28 21:45:12 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:12 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66" returned: 0 in 0.374s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:45:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:12 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd 1G Sep 28 21:45:12 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:13 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd 1G" returned: 0 in 0.551s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:13 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd Sep 28 21:45:13 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:13 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd" returned: 0 in 0.341s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:13 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd is being set with open permissions: ugo+rw Sep 28 21:45:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:13 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd Sep 28 21:45:13 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:13 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd" returned: 0 in 0.304s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.717s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:14 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a309b26a-9301-41b8-be45-3d8fff766d9b tempest-VolumesSnapshotListTestJSON-1240480628 None] Create snapshot completed successfully Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-71fddf0a-2898-4a32-9613-a3acb6ad0fcd-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-71fddf0a-2898-4a32-9613-a3acb6ad0fcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-quobyte-71fddf0a-2898-4a32-9613-a3acb6ad0fcd" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-71fddf0a-2898-4a32-9613-a3acb6ad0fcd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Deleting offline snapshot 71fddf0a-2898-4a32-9613-a3acb6ad0fcd of volume f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] snapshot_file for this snap is: volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c07319-b586-443b-9290-3d9de4dad01c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:15 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd Sep 28 21:45:15 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:16 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd" returned: 0 in 0.455s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:45:16 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa8eeac-4b7d-4a1b-ae11-6c8867da764a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:16 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 Sep 28 21:45:16 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:16 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66" returned: 0 in 0.503s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:45:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:16 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd Sep 28 21:45:16 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:17 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd" returned: 0 in 0.519s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:17 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd Sep 28 21:45:17 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:17 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.71fddf0a-2898-4a32-9613-a3acb6ad0fcd" returned: 0 in 0.299s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-71fddf0a-2898-4a32-9613-a3acb6ad0fcd" released by "_delete_snapshot" :: held 1.925s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" released by "delete_snapshot" :: held 1.958s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:17 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Created reservations ['84bb956e-7373-488d-b44a-f39006dacdf2', '49cf4555-abf8-46e0-a8dd-6d8ea5093e44', '65256c5a-6489-48e2-836b-a52a6d3941b8', '72d25b35-8af4-4c8e-9833-bef712357878'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:45:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Delete snapshot completed successfully. Sep 28 21:45:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bcc944f1-70e6-4930-8759-a9d287548df9 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-71fddf0a-2898-4a32-9613-a3acb6ad0fcd-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-523ea1cd-0663-441c-9bc7-bb47b0946c66-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-523ea1cd-0663-441c-9bc7-bb47b0946c66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-quobyte-523ea1cd-0663-441c-9bc7-bb47b0946c66" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-523ea1cd-0663-441c-9bc7-bb47b0946c66" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Deleting offline snapshot 523ea1cd-0663-441c-9bc7-bb47b0946c66 of volume f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] snapshot_file for this snap is: volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ddd0c0-b703-48d5-a88f-cd6944839943]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-be0bd3f2-444d-45bf-920b-23a3bea33300 req-4ea0cdde-fc0f-4353-bbd4-3d42fca1f6fe tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-be0bd3f2-444d-45bf-920b-23a3bea33300 req-4ea0cdde-fc0f-4353-bbd4-3d42fca1f6fe tempest-TestStampPattern-1833587336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-be0bd3f2-444d-45bf-920b-23a3bea33300 req-4ea0cdde-fc0f-4353-bbd4-3d42fca1f6fe tempest-TestStampPattern-1833587336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:19 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 Sep 28 21:45:19 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-be0bd3f2-444d-45bf-920b-23a3bea33300 req-4ea0cdde-fc0f-4353-bbd4-3d42fca1f6fe tempest-TestStampPattern-1833587336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3474795f-3f98-4e2b-b41a-dd9dd6ff2ab5', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:45:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-be0bd3f2-444d-45bf-920b-23a3bea33300 req-4ea0cdde-fc0f-4353-bbd4-3d42fca1f6fe tempest-TestStampPattern-1833587336 None] attachment_update completed successfully. Sep 28 21:45:19 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66" returned: 0 in 0.469s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:45:19 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[be010bce-65c2-4daa-b6a4-d1e2e3f3c5fc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:19 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 Sep 28 21:45:19 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:20 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091" returned: 0 in 0.610s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:45:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:20 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 Sep 28 21:45:20 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:20 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66" returned: 0 in 0.702s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:20 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66 Sep 28 21:45:20 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:21 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.523ea1cd-0663-441c-9bc7-bb47b0946c66" returned: 0 in 0.417s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-523ea1cd-0663-441c-9bc7-bb47b0946c66" released by "_delete_snapshot" :: held 2.358s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" released by "delete_snapshot" :: held 2.393s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:21 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Created reservations ['da061964-226c-494f-8e03-bd1a3d4b67fb', '84b369ff-980b-4034-8c95-f82607e95b62', 'de1940dd-24cb-4f2f-9e4b-3c7d8cd492be', 'b2dac7a0-2e51-4110-b1d2-665f33bb5670'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:45:21 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Delete snapshot completed successfully. Sep 28 21:45:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f288e214-ce83-4f28-a545-a89097253741 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-523ea1cd-0663-441c-9bc7-bb47b0946c66-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-1146c062-9f71-46c2-9ea3-4d0d1ee0d091-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-1146c062-9f71-46c2-9ea3-4d0d1ee0d091-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-quobyte-1146c062-9f71-46c2-9ea3-4d0d1ee0d091" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-1146c062-9f71-46c2-9ea3-4d0d1ee0d091" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Deleting offline snapshot 1146c062-9f71-46c2-9ea3-4d0d1ee0d091 of volume f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] snapshot_file for this snap is: volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[034982b7-ad79-41e6-ad5e-4e187a8ef97d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:22 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 Sep 28 21:45:22 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:22 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091" returned: 0 in 0.659s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc4a15f-8636-4bda-864e-cc7716bbf5c6]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:23 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 Sep 28 21:45:23 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:23 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373" returned: 0 in 0.436s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:23 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 Sep 28 21:45:23 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:23 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091" returned: 0 in 0.447s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:23 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091 Sep 28 21:45:23 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:24 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373.1146c062-9f71-46c2-9ea3-4d0d1ee0d091" returned: 0 in 0.358s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-1146c062-9f71-46c2-9ea3-4d0d1ee0d091" released by "_delete_snapshot" :: held 2.086s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" released by "delete_snapshot" :: held 2.133s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:24 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Created reservations ['5f06750a-e947-4453-85aa-7b079b9300ed', 'ca07673a-01d0-40bc-8a2b-c886a77548fc', '5f3a0e31-d987-4eae-a1b9-b5912270fba2', '93a0b808-17dd-4980-a6af-e9ba38480421'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:45:24 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Delete snapshot completed successfully. Sep 28 21:45:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bb7ec590-0321-4a03-9762-f828bc536038 tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-1146c062-9f71-46c2-9ea3-4d0d1ee0d091-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-f1a7e7bf-aa84-42a3-94d5-1301c0514373-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-f1a7e7bf-aa84-42a3-94d5-1301c0514373-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:25 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0bb441-b993-4e8a-a5ba-a3597ddf8b9f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:25 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-7e8620f2-94b3-4c6e-a8e4-74afb80c4b78 req-d96db452-855d-4f3a-a5c8-e78b5d3b760f tempest-TestStampPattern-1833587336 None] Terminate volume connection completed successfully. Sep 28 21:45:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7e8620f2-94b3-4c6e-a8e4-74afb80c4b78 req-d96db452-855d-4f3a-a5c8-e78b5d3b760f tempest-TestStampPattern-1833587336 None] Deleting attachment 3474795f-3f98-4e2b-b41a-dd9dd6ff2ab5. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:45:25 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 Sep 28 21:45:25 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:26 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373" returned: 0 in 0.634s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:26 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373 Sep 28 21:45:26 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Creating offline snapshot c7ba5d49-19cc-46e5-af34-5d1039196ae7 of volume 4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:45:26 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f1a7e7bf-aa84-42a3-94d5-1301c0514373" returned: 0 in 0.440s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5669a07-a028-47e6-8812-c58487bb9721]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-quobyte-f1a7e7bf-aa84-42a3-94d5-1301c0514373" released by "delete_volume" :: held 1.226s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Created reservations ['0ea938e8-b02c-4ada-a759-9acb7424209a', '767241a5-3272-424e-92da-cf0a497b2b95', 'a045fd88-2105-48ae-87f6-773995059be2', '100bdbcc-aee3-4d10-8410-2ed330e8b04f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:45:27 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 Sep 28 21:45:27 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:27 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:45:27 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:27 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" returned: 0 in 0.700s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:27 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 1G Sep 28 21:45:27 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:27 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.489s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:45:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Deleted volume successfully. Sep 28 21:45:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d70ed346-5145-40b3-904d-0d3e62de3afb tempest-VolumesSnapshotListTestJSON-1240480628 None] Lock "cinder-f1a7e7bf-aa84-42a3-94d5-1301c0514373-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:28 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 1G" returned: 0 in 0.963s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:28 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 Sep 28 21:45:28 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:28 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7" returned: 0 in 0.479s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:28 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 is being set with open permissions: ugo+rw Sep 28 21:45:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:29 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 Sep 28 21:45:29 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:29 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7" returned: 0 in 0.419s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:29 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.info Sep 28 21:45:29 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-f6432b07-4872-4f49-a73c-d263b61384f4 tempest-TestShelveInstance-1369226075 None] Terminate volume connection completed successfully. Sep 28 21:45:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-f6432b07-4872-4f49-a73c-d263b61384f4 tempest-TestShelveInstance-1369226075 None] Deleting attachment b8912638-e608-4919-b76e-981e5679eed1. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:45:29 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.info" returned: 0 in 0.485s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:29 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.info is being set with open permissions: ugo+rw Sep 28 21:45:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:29 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.info Sep 28 21:45:29 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Acquiring lock "cinder-41257130-60ea-4349-bc39-701878b3c38e-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Lock "cinder-41257130-60ea-4349-bc39-701878b3c38e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Acquiring lock "cinder-quobyte-41257130-60ea-4349-bc39-701878b3c38e" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Lock "cinder-quobyte-41257130-60ea-4349-bc39-701878b3c38e" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:30 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d81f91a-8002-42d4-8df0-087a04a7b501]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:30 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.info" returned: 0 in 0.486s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.727s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0f9b15b2-f023-42ea-8c14-ae0edef13e48 tempest-TestStampPattern-1833587336 None] Create snapshot completed successfully Sep 28 21:45:30 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e Sep 28 21:45:30 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:31 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e" returned: 0 in 0.774s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:31 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e Sep 28 21:45:31 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:31 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-41257130-60ea-4349-bc39-701878b3c38e" returned: 0 in 0.339s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Lock "cinder-quobyte-41257130-60ea-4349-bc39-701878b3c38e" released by "delete_volume" :: held 1.204s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG cinder.quota [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Created reservations ['162c9144-0b49-4f2f-ae15-87c84a698be2', 'fb0418e4-5672-4f14-91f1-3e76ed0611da', 'b14c5376-8fde-41bf-968f-885c0ff3b8d7', 'fb982962-8a3c-4930-898e-9543a55d53c6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:31 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:45:31 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:32 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.443s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:32 devstack cinder-volume[86489]: DEBUG cinder.manager [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:45:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Deleted volume successfully. Sep 28 21:45:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-66ab79c6-335a-4559-a021-99655bfcc4c5 req-cd346873-5bae-4d82-b75c-9833a9b841f0 tempest-TestShelveInstance-1369226075 None] Lock "cinder-41257130-60ea-4349-bc39-701878b3c38e-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Flow 'volume_create_manager' (6b244b5f-57ca-4755-aede-c7b5f1148f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a97c287-6b4a-4ef1-9c9e-ba350e4f6ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a97c287-6b4a-4ef1-9c9e-ba350e4f6ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1423790031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d788704d-e710-41d8-9e9b-e70e02bea719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be14227d971945df89551fe57ec74d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7ba5d49-19cc-46e5-af34-5d1039196ae7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:45:39Z,use_quota=True,user_id='d0e76acf7a044c54987fdc02f93fc8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bc5c23-93f7-4b3e-8a61-c16751492d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bc5c23-93f7-4b3e-8a61-c16751492d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e4d0ff-094f-4852-a91d-90aee00774d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e4d0ff-094f-4852-a91d-90aee00774d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd788704d-e710-41d8-9e9b-e70e02bea719', 'volume_name': 'volume-d788704d-e710-41d8-9e9b-e70e02bea719', 'volume_size': 1, 'snapshot_id': 'c7ba5d49-19cc-46e5-af34-5d1039196ae7'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc79aa75-3896-424f-a490-c2e26e9ed43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc79aa75-3896-424f-a490-c2e26e9ed43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca7e9c3-8967-4bb4-a42f-62eaeb5ba4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:39 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Volume d788704d-e710-41d8-9e9b-e70e02bea719: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d788704d-e710-41d8-9e9b-e70e02bea719', 'volume_size': 1, 'snapshot_id': 'c7ba5d49-19cc-46e5-af34-5d1039196ae7'} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-quobyte-c7ba5d49-19cc-46e5-af34-5d1039196ae7-d788704d-e710-41d8-9e9b-e70e02bea719" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-c7ba5d49-19cc-46e5-af34-5d1039196ae7-d788704d-e710-41d8-9e9b-e70e02bea719" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Creating volume d788704d-e710-41d8-9e9b-e70e02bea719 from snapshot c7ba5d49-19cc-46e5-af34-5d1039196ae7 {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-quobyte-d788704d-e710-41d8-9e9b-e70e02bea719" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-d788704d-e710-41d8-9e9b-e70e02bea719" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] snapshot: c7ba5d49-19cc-46e5-af34-5d1039196ae7, volume: d788704d-e710-41d8-9e9b-e70e02bea719, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d62129-5d02-46e0-a7fc-36e9d3edabe0]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:39 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 Sep 28 21:45:39 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:40 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7" returned: 0 in 0.444s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e7497-0f46-45b1-a962-c20698d0b2f5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:40 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 Sep 28 21:45:40 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:40 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" returned: 0 in 0.428s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:45:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:40 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 Sep 28 21:45:40 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:49 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=48,cinder:SELECT=60,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:45:49 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=68,cinder:INSERT=16,cinder:UPDATE=63,cinder:DELETE=4 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Flow 'volume_create_manager' (7d73cb74-1f96-4297-8ab2-46e971435a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28e0a8f-9c95-44fc-909e-fbb2bb277677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28e0a8f-9c95-44fc-909e-fbb2bb277677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-809872894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d51f09-ab15-4675-9458-da0dae44677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30262c26c6b84af2b4e3234f0132e7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:45:50Z,use_quota=True,user_id='555537f36df0446190174d03f0ab8fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df22076-a3b0-487c-866b-484aa3043adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df22076-a3b0-487c-866b-484aa3043adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddf753c-cebf-4c96-beb7-765cd7a2453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddf753c-cebf-4c96-beb7-765cd7a2453f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d51f09-ab15-4675-9458-da0dae44677c', 'volume_name': 'volume-09d51f09-ab15-4675-9458-da0dae44677c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3b3f4f-06c4-40fd-8bf5-72b33faaa22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3b3f4f-06c4-40fd-8bf5-72b33faaa22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81fce05-5526-46fc-9259-ffbb0e175198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Volume 09d51f09-ab15-4675-9458-da0dae44677c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d51f09-ab15-4675-9458-da0dae44677c', 'volume_size': 1} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:50 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719" returned: 0 in 10.284s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9, size 1024.00 MB, duration 10.29 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:45:50 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Converted 1024.00 MB image at 99.56 MB/s Sep 28 21:45:50 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 is being set with open permissions: ugo+rw Sep 28 21:45:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:50 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 Sep 28 21:45:50 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:51 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-d788704d-e710-41d8-9e9b-e70e02bea719" released by "_copy_volume_from_snapshot" :: held 11.646s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-c7ba5d49-19cc-46e5-af34-5d1039196ae7-d788704d-e710-41d8-9e9b-e70e02bea719" released by "_create_volume_from_snapshot" :: held 11.767s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.796s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-809872894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d51f09-ab15-4675-9458-da0dae44677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30262c26c6b84af2b4e3234f0132e7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:45:50Z,use_quota=True,user_id='555537f36df0446190174d03f0ab8fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Creating volume 09d51f09-ab15-4675-9458-da0dae44677c {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:45:51 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:51 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c 1073741824 Sep 28 21:45:51 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca7e9c3-8967-4bb4-a42f-62eaeb5ba4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d788704d-e710-41d8-9e9b-e70e02bea719', 'volume_size': 1, 'snapshot_id': 'c7ba5d49-19cc-46e5-af34-5d1039196ae7'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c9f1cd-02c9-4fc2-aba7-3e9ab3627dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:51 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Volume volume-d788704d-e710-41d8-9e9b-e70e02bea719 (d788704d-e710-41d8-9e9b-e70e02bea719): created successfully Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c9f1cd-02c9-4fc2-aba7-3e9ab3627dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Flow 'volume_create_manager' (6b244b5f-57ca-4755-aede-c7b5f1148f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:45:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c8396fda-cf02-4a5d-b724-fbad2dc443c0 tempest-TestStampPattern-1833587336 None] Created volume successfully. Sep 28 21:45:52 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c 1073741824" returned: 0 in 0.634s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:45:52 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c Sep 28 21:45:52 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:45:52 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c" returned: 0 in 0.330s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81fce05-5526-46fc-9259-ffbb0e175198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d51f09-ab15-4675-9458-da0dae44677c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af57d9c-b46f-418d-acc6-3427dfcbe46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:45:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Volume volume-09d51f09-ab15-4675-9458-da0dae44677c (09d51f09-ab15-4675-9458-da0dae44677c): created successfully Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af57d9c-b46f-418d-acc6-3427dfcbe46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:45:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Flow 'volume_create_manager' (7d73cb74-1f96-4297-8ab2-46e971435a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:45:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-02d3c1f2-f3ab-4214-a9bb-cfa8dfd8fa39 tempest-AttachVolumeNegativeTest-2091995112 None] Created volume successfully. Sep 28 21:45:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-9bf7affc-829f-4fc5-8676-b360256fc098 req-3f9c124d-9317-40cb-b24b-05b323928980 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:45:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-9bf7affc-829f-4fc5-8676-b360256fc098 req-3f9c124d-9317-40cb-b24b-05b323928980 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:45:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-9bf7affc-829f-4fc5-8676-b360256fc098 req-3f9c124d-9317-40cb-b24b-05b323928980 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:45:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-9bf7affc-829f-4fc5-8676-b360256fc098 req-3f9c124d-9317-40cb-b24b-05b323928980 tempest-AttachVolumeNegativeTest-2091995112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-09d51f09-ab15-4675-9458-da0dae44677c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '625f83d9-c13d-4f29-ac43-fc4aeee55ed0', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:45:54 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-9bf7affc-829f-4fc5-8676-b360256fc098 req-3f9c124d-9317-40cb-b24b-05b323928980 tempest-AttachVolumeNegativeTest-2091995112 None] attachment_update completed successfully. Sep 28 21:45:57 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-2157faec-25ab-4ad1-89ae-f1dc4f7dc545 req-523b7700-f3a3-4629-ab14-2ccbef23a968 tempest-AttachVolumeNegativeTest-2091995112 None] Terminate volume connection completed successfully. Sep 28 21:45:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-2157faec-25ab-4ad1-89ae-f1dc4f7dc545 req-523b7700-f3a3-4629-ab14-2ccbef23a968 tempest-AttachVolumeNegativeTest-2091995112 None] Deleting attachment 625f83d9-c13d-4f29-ac43-fc4aeee55ed0. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:46:04 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:46:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:46:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:07 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:07 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:07 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "cinder-09d51f09-ab15-4675-9458-da0dae44677c-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:08 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.802s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Flow 'volume_create_manager' (86ec0ce0-392f-4c7b-8dd8-1e52b09bffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba309a3-6505-4855-ba10-1af83bea3259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-09d51f09-ab15-4675-9458-da0dae44677c-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba309a3-6505-4855-ba10-1af83bea3259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4921e5-bfa7-462b-a45e-e6f202d383cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66df49736a743ad8cd874fa67488d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:08Z,use_quota=True,user_id='e60f361e9ee0483bb96d9c8858b14825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee692e3c-43fe-4520-b9f1-ca1a56b14cef),volume_type_id=ee692e3c-43fe-4520-b9f1-ca1a56b14cef)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe7e814-9da9-4c59-9ab3-fbdf3d42a1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe7e814-9da9-4c59-9ab3-fbdf3d42a1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b649e43c-6489-45a5-b11e-4eecae61289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "cinder-quobyte-09d51f09-ab15-4675-9458-da0dae44677c" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-quobyte-09d51f09-ab15-4675-9458-da0dae44677c" acquired by "delete_volume" :: waited 0.043s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98ec22-c275-4975-b156-97624346b5b9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:08 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c Sep 28 21:46:08 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b649e43c-6489-45a5-b11e-4eecae61289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a4921e5-bfa7-462b-a45e-e6f202d383cf', 'volume_name': 'volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf', 'volume_size': 1, 'image_id': 'e08baf51-d173-4fb6-b230-d93e6351a636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e08baf51-d173-4fb6-b230-d93e6351a636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '716907985a49ce074da0b5a41dafd5bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b66df49736a743ad8cd874fa67488d5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7df481f0e88cd6fc31161adfda8b557ea49a1ae6716478dc1ab8a7a08193ae66a4d864d7a1e2654ba2049a08e2020a1d117253940d158b95cbace5c205b22c7f', 'id': 'e08baf51-d173-4fb6-b230-d93e6351a636', 'created_at': datetime.datetime(2026, 9, 28, 19, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 46, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e08baf51-d173-4fb6-b230-d93e6351a636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a93f0ca-5df0-4abf-bee6-c89a6cbd70c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a93f0ca-5df0-4abf-bee6-c89a6cbd70c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4729eb6b-8390-4a5b-8e10-7c4359cc3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:08 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Volume 5a4921e5-bfa7-462b-a45e-e6f202d383cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf', 'volume_size': 1, 'image_id': 'e08baf51-d173-4fb6-b230-d93e6351a636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e08baf51-d173-4fb6-b230-d93e6351a636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '716907985a49ce074da0b5a41dafd5bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b66df49736a743ad8cd874fa67488d5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7df481f0e88cd6fc31161adfda8b557ea49a1ae6716478dc1ab8a7a08193ae66a4d864d7a1e2654ba2049a08e2020a1d117253940d158b95cbace5c205b22c7f', 'id': 'e08baf51-d173-4fb6-b230-d93e6351a636', 'created_at': datetime.datetime(2026, 9, 28, 19, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 46, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e08baf51-d173-4fb6-b230-d93e6351a636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 21:46:08 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Trying to clone 5a4921e5-bfa7-462b-a45e-e6f202d383cf from image e08baf51-d173-4fb6-b230-d93e6351a636 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e08baf51-d173-4fb6-b230-d93e6351a636', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:46:09 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Image download 0.00 MB at 0.00 MB/s Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7f3ccb-3a7e-410f-a90a-ad97697adc34]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:09 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c" returned: 0 in 0.732s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:09 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c Sep 28 21:46:09 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:09 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD Sep 28 21:46:09 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:09 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:09 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09d51f09-ab15-4675-9458-da0dae44677c" returned: 0 in 0.514s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:09 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD Sep 28 21:46:09 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-quobyte-09d51f09-ab15-4675-9458-da0dae44677c" released by "delete_volume" :: held 1.349s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Created reservations ['dc01dd4e-57df-440c-808f-3a3a5455b963', '6c033901-badc-4d23-a3ad-db1ab25ff2cb', '446bec51-48d2-4c85-a64f-6660ebdb8f81', '554f7497-68d2-4325-bfe4-57a77aa1872f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:10 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:10 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:10 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Temporary image e08baf51-d173-4fb6-b230-d93e6351a636 is fetched for user e60f361e9ee0483bb96d9c8858b14825. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07111ca-8828-4d02-978d-bcf438e45908]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:10 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.389s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Deleted volume successfully. Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e4a2a561-b2c0-4c10-8f61-0168e6df7c26 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-09d51f09-ab15-4675-9458-da0dae44677c-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:10 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD Sep 28 21:46:10 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "cinder-763377ae-4ab0-44a3-a8a3-c80323026dd2-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-763377ae-4ab0-44a3-a8a3-c80323026dd2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "cinder-quobyte-763377ae-4ab0-44a3-a8a3-c80323026dd2" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-quobyte-763377ae-4ab0-44a3-a8a3-c80323026dd2" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc77374-fec1-4013-a70e-613ddd710878]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:11 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:11 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 Sep 28 21:46:11 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:11 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD Sep 28 21:46:11 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:11 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2" returned: 0 in 0.554s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:11 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD" returned: 1 in 0.513s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4921e5-bfa7-462b-a45e-e6f202d383cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66df49736a743ad8cd874fa67488d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:08Z,use_quota=True,user_id='e60f361e9ee0483bb96d9c8858b14825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee692e3c-43fe-4520-b9f1-ca1a56b14cef),volume_type_id=ee692e3c-43fe-4520-b9f1-ca1a56b14cef)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Creating volume 5a4921e5-bfa7-462b-a45e-e6f202d383cf {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:11 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2 Sep 28 21:46:11 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:11 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:11 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf 1073741824 Sep 28 21:46:11 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:12 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-763377ae-4ab0-44a3-a8a3-c80323026dd2" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-quobyte-763377ae-4ab0-44a3-a8a3-c80323026dd2" released by "delete_volume" :: held 1.033s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Created reservations ['21b4f5e4-fa15-46fa-b355-330886328874', '260ced5c-b6bf-432e-b018-e3cdd6b826ce', 'ee50f340-41d1-4967-b0c2-4bbca2ff72f2', '8e2253c1-9527-4284-9039-fd23e028230b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:12 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:12 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:12 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf 1073741824" returned: 0 in 0.709s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:12 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf Sep 28 21:46:12 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:12 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.347s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:12 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Deleted volume successfully. Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-977232f3-3bb7-4927-96e0-866a45460b10 tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-763377ae-4ab0-44a3-a8a3-c80323026dd2-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:12 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf" returned: 0 in 0.325s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Attempting download of e08baf51-d173-4fb6-b230-d93e6351a636 ((None, [{'url': 'file:///opt/stack/data/glance/images/e08baf51-d173-4fb6-b230-d93e6351a636', 'metadata': {}}])) to volume 5a4921e5-bfa7-462b-a45e-e6f202d383cf. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec237a0-ad89-4686-9c34-23026b8c9490]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e08baf51-d173-4fb6-b230-d93e6351a636_9il28ejy {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:13 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e08baf51-d173-4fb6-b230-d93e6351a636_9il28ejy Sep 28 21:46:13 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:13 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e08baf51-d173-4fb6-b230-d93e6351a636_9il28ejy" returned: 0 in 0.387s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e08baf51-d173-4fb6-b230-d93e6351a636_9il28ejy {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:13 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e08baf51-d173-4fb6-b230-d93e6351a636_9il28ejy Sep 28 21:46:13 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "cinder-3ab0ec42-67a5-480c-80a0-765d64dbc5a8-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-3ab0ec42-67a5-480c-80a0-765d64dbc5a8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "cinder-quobyte-3ab0ec42-67a5-480c-80a0-765d64dbc5a8" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-quobyte-3ab0ec42-67a5-480c-80a0-765d64dbc5a8" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5146433e-7275-41ff-8e96-768eb2e5c7b7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:13 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e08baf51-d173-4fb6-b230-d93e6351a636_9il28ejy" returned: 1 in 0.407s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e08baf51-d173-4fb6-b230-d93e6351a636_9il28ejy' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bc4a7a-6962-421a-b1a6-ea8de54f6610]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:13 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 Sep 28 21:46:13 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:13 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD Sep 28 21:46:13 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:14 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:14 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD Sep 28 21:46:14 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:14 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8" returned: 0 in 0.610s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:14 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8 Sep 28 21:46:14 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:14 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD" returned: 1 in 0.466s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] e08baf51-d173-4fb6-b230-d93e6351a636 was raw, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:14 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf Sep 28 21:46:14 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:14 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3ab0ec42-67a5-480c-80a0-765d64dbc5a8" returned: 0 in 0.525s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-quobyte-3ab0ec42-67a5-480c-80a0-765d64dbc5a8" released by "delete_volume" :: held 1.215s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:14 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Created reservations ['86cf8d50-a3b1-4dc6-824f-2231f0465b01', '05c8baad-2904-47ce-8d21-b90b699e164f', 'c4d14a83-5b82-472e-ae80-58cf76e5e1aa', '1a91ae82-35aa-4977-85af-04b2bea8e7df'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:15 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:15 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:15 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf" returned: 0 in 0.706s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e08baf51-d173-4fb6-b230-d93e6351a636_ap74gwpddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:46:15 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:15 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.310s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Deleted volume successfully. Sep 28 21:46:15 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf 1G Sep 28 21:46:15 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c7f2b4d1-6e23-4976-b097-da01c59ff6ac tempest-AttachVolumeNegativeTest-2091995112 None] Lock "cinder-3ab0ec42-67a5-480c-80a0-765d64dbc5a8-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:15 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf 1G" returned: 0 in 0.465s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Downloaded image e08baf51-d173-4fb6-b230-d93e6351a636 ((None, [{'url': 'file:///opt/stack/data/glance/images/e08baf51-d173-4fb6-b230-d93e6351a636', 'metadata': {}}])) to volume 5a4921e5-bfa7-462b-a45e-e6f202d383cf successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Temporary image e08baf51-d173-4fb6-b230-d93e6351a636 for user e60f361e9ee0483bb96d9c8858b14825 is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Marking volume 5a4921e5-bfa7-462b-a45e-e6f202d383cf as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Copying metadata from image e08baf51-d173-4fb6-b230-d93e6351a636 to 5a4921e5-bfa7-462b-a45e-e6f202d383cf. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:46:15 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Creating volume glance metadata for volume 5a4921e5-bfa7-462b-a45e-e6f202d383cf backed by image e08baf51-d173-4fb6-b230-d93e6351a636 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e08baf51-d173-4fb6-b230-d93e6351a636', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '716907985a49ce074da0b5a41dafd5bf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:46:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4729eb6b-8390-4a5b-8e10-7c4359cc3a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf', 'volume_size': 1, 'image_id': 'e08baf51-d173-4fb6-b230-d93e6351a636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e08baf51-d173-4fb6-b230-d93e6351a636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '716907985a49ce074da0b5a41dafd5bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b66df49736a743ad8cd874fa67488d5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7df481f0e88cd6fc31161adfda8b557ea49a1ae6716478dc1ab8a7a08193ae66a4d864d7a1e2654ba2049a08e2020a1d117253940d158b95cbace5c205b22c7f', 'id': 'e08baf51-d173-4fb6-b230-d93e6351a636', 'created_at': datetime.datetime(2026, 9, 28, 19, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 46, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e08baf51-d173-4fb6-b230-d93e6351a636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1423d7ad-7334-4d6c-b38a-3888f87c16f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:16 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Volume volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf (5a4921e5-bfa7-462b-a45e-e6f202d383cf): created successfully Sep 28 21:46:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1423d7ad-7334-4d6c-b38a-3888f87c16f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Flow 'volume_create_manager' (86ec0ce0-392f-4c7b-8dd8-1e52b09bffa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-417d7f18-3aec-4928-b129-de0b90fc4cbd tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Created volume successfully. Sep 28 21:46:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Acquiring lock "cinder-5a4921e5-bfa7-462b-a45e-e6f202d383cf-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "cinder-5a4921e5-bfa7-462b-a45e-e6f202d383cf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Acquiring lock "cinder-quobyte-5a4921e5-bfa7-462b-a45e-e6f202d383cf" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "cinder-quobyte-5a4921e5-bfa7-462b-a45e-e6f202d383cf" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a519df-a214-4297-ab14-a6789b08c6d7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:17 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf Sep 28 21:46:17 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:17 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf" returned: 0 in 0.723s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:18 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf Sep 28 21:46:18 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:18 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5a4921e5-bfa7-462b-a45e-e6f202d383cf" returned: 0 in 0.499s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "cinder-quobyte-5a4921e5-bfa7-462b-a45e-e6f202d383cf" released by "delete_volume" :: held 1.285s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:18 devstack cinder-volume[86489]: WARNING cinder.quota [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:46:18 devstack cinder-volume[86489]: WARNING cinder.quota [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Created reservations ['ed8959d0-08d8-4d39-a8f0-7228a44b82b6', '31525b00-884d-4d2c-b45e-74c034ec423b', 'e4714cfe-4c3e-4ce2-bf62-5f5f78d3875a', 'dd76e043-9f21-43d5-bb3c-29b2eef5d065'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:18 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:18 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:18 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.287s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:18 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:18 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Deleted volume successfully. Sep 28 21:46:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5adf82e9-ec51-4a69-8f57-d49a59b781f9 tempest-VolumeAndVolumeTypeFromImageTest-586339539 None] Lock "cinder-5a4921e5-bfa7-462b-a45e-e6f202d383cf-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Flow 'volume_create_manager' (b229aecb-9a05-4f82-82b2-5cee8c4dcdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea9d68-ea5f-49dd-af00-1915cce04f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea9d68-ea5f-49dd-af00-1915cce04f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2000262418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7508aa9b-1257-4d5d-96ab-70610fd813f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f3304713b43c8b09f21f1b46b61d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:24Z,use_quota=True,user_id='a4b3945ae7f34cd7b1220bedbb2199c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853f9485-0679-4ec9-ae3f-e2d2fa387a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853f9485-0679-4ec9-ae3f-e2d2fa387a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712440b2-fc3c-4fbd-81ae-bb775f69e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712440b2-fc3c-4fbd-81ae-bb775f69e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7508aa9b-1257-4d5d-96ab-70610fd813f1', 'volume_name': 'volume-7508aa9b-1257-4d5d-96ab-70610fd813f1', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7c321c-038c-479e-9be5-5d8d4a806f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7c321c-038c-479e-9be5-5d8d4a806f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e3ad29-6b22-4415-95cf-fd1557b787d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:24 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Volume 7508aa9b-1257-4d5d-96ab-70610fd813f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7508aa9b-1257-4d5d-96ab-70610fd813f1', 'volume_size': 1} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2000262418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7508aa9b-1257-4d5d-96ab-70610fd813f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f3304713b43c8b09f21f1b46b61d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:24Z,use_quota=True,user_id='a4b3945ae7f34cd7b1220bedbb2199c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Creating volume 7508aa9b-1257-4d5d-96ab-70610fd813f1 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:24 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:24 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 1073741824 Sep 28 21:46:24 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:24 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 1073741824" returned: 0 in 0.695s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:25 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 Sep 28 21:46:25 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:25 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1" returned: 0 in 0.369s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e3ad29-6b22-4415-95cf-fd1557b787d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7508aa9b-1257-4d5d-96ab-70610fd813f1', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55281bcb-4767-4a08-9097-2aa123bcb3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Volume volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 (7508aa9b-1257-4d5d-96ab-70610fd813f1): created successfully Sep 28 21:46:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55281bcb-4767-4a08-9097-2aa123bcb3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Flow 'volume_create_manager' (b229aecb-9a05-4f82-82b2-5cee8c4dcdb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:25 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6c9c0c86-7654-48f9-925a-70affaafd427 tempest-TestMinimumBasicScenario-1942971503 None] Created volume successfully. Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (3baa3515-2ae3-4c24-be42-6c5b80a52563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e214463-06e4-42b7-8dc1-a475bd201127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e214463-06e4-42b7-8dc1-a475bd201127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2119707103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4f399d-e19b-41cf-9d3f-c4b68a3edee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:26Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae64439-e180-407f-a40b-ba203fc8bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae64439-e180-407f-a40b-ba203fc8bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e751c9fb-1096-4e87-85c7-32dd404c3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e751c9fb-1096-4e87-85c7-32dd404c3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4f399d-e19b-41cf-9d3f-c4b68a3edee4', 'volume_name': 'volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb93e8a-9d4a-4268-88c5-e11f0b6329df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb93e8a-9d4a-4268-88c5-e11f0b6329df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc57044-eae3-4726-9db2-3ab23d60f03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume 7f4f399d-e19b-41cf-9d3f-c4b68a3edee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4', 'volume_size': 1} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2119707103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4f399d-e19b-41cf-9d3f-c4b68a3edee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:26Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Creating volume 7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:26 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:26 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 1073741824 Sep 28 21:46:26 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:27 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 1073741824" returned: 0 in 0.905s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:27 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 Sep 28 21:46:27 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-56c29830-aaab-4152-812c-77dfda92ffe8 req-4da816c4-5bae-48ef-b2f3-2b8c8c97e9cb tempest-TestMinimumBasicScenario-1942971503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:27 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4" returned: 0 in 0.485s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-56c29830-aaab-4152-812c-77dfda92ffe8 req-4da816c4-5bae-48ef-b2f3-2b8c8c97e9cb tempest-TestMinimumBasicScenario-1942971503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.119s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc57044-eae3-4726-9db2-3ab23d60f03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4794d6d8-d883-4c41-a97c-2cdfb898791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-56c29830-aaab-4152-812c-77dfda92ffe8 req-4da816c4-5bae-48ef-b2f3-2b8c8c97e9cb tempest-TestMinimumBasicScenario-1942971503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:28 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 (7f4f399d-e19b-41cf-9d3f-c4b68a3edee4): created successfully Sep 28 21:46:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4794d6d8-d883-4c41-a97c-2cdfb898791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (3baa3515-2ae3-4c24-be42-6c5b80a52563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0bd14595-74df-4e6c-99f2-d6609d2e206f tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created volume successfully. Sep 28 21:46:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-56c29830-aaab-4152-812c-77dfda92ffe8 req-4da816c4-5bae-48ef-b2f3-2b8c8c97e9cb tempest-TestMinimumBasicScenario-1942971503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-7508aa9b-1257-4d5d-96ab-70610fd813f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5afcb4d1-3aec-4ae3-b020-deed85785f9b', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:46:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-56c29830-aaab-4152-812c-77dfda92ffe8 req-4da816c4-5bae-48ef-b2f3-2b8c8c97e9cb tempest-TestMinimumBasicScenario-1942971503 None] attachment_update completed successfully. Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (b9916044-9845-49a4-ba71-267f43503da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b513d0d1-a3f7-4962-97a1-4ef24de2a699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b513d0d1-a3f7-4962-97a1-4ef24de2a699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8291765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217377f3-8bf4-4376-94e6-498b7aac0919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:29Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1bef7e-0540-46d4-a1d3-0c4012f10baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1bef7e-0540-46d4-a1d3-0c4012f10baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757e4e9b-3aae-4693-8f57-7c59234be005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757e4e9b-3aae-4693-8f57-7c59234be005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217377f3-8bf4-4376-94e6-498b7aac0919', 'volume_name': 'volume-217377f3-8bf4-4376-94e6-498b7aac0919', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da902c07-08eb-48fb-9eab-ee35eb55c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da902c07-08eb-48fb-9eab-ee35eb55c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb62dfd7-da0e-40f6-a5c9-135423bbcd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:29 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume 217377f3-8bf4-4376-94e6-498b7aac0919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217377f3-8bf4-4376-94e6-498b7aac0919', 'volume_size': 1} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8291765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217377f3-8bf4-4376-94e6-498b7aac0919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:29Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Creating volume 217377f3-8bf4-4376-94e6-498b7aac0919 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:29 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:29 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 1073741824 Sep 28 21:46:29 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:30 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (efbf11d0-c10e-46e2-86d8-fec62c69bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe967a1-6033-4064-9853-c9c701eb34a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 1073741824" returned: 0 in 0.874s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe967a1-6033-4064-9853-c9c701eb34a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634220979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e32b30-44b3-4a10-ad72-af709debe4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:30Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77640705-5480-49a7-bbd7-fb9cb0c7bbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77640705-5480-49a7-bbd7-fb9cb0c7bbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200b740e-aef6-4b21-a820-e800d7068475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200b740e-aef6-4b21-a820-e800d7068475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e32b30-44b3-4a10-ad72-af709debe4f0', 'volume_name': 'volume-b8e32b30-44b3-4a10-ad72-af709debe4f0', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e81a8c-419e-41b8-a8a2-ff48330be922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e81a8c-419e-41b8-a8a2-ff48330be922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9445a7-203d-4d8d-b588-6d32a4bcec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume b8e32b30-44b3-4a10-ad72-af709debe4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e32b30-44b3-4a10-ad72-af709debe4f0', 'volume_size': 1} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:30 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 Sep 28 21:46:30 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:30 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919" returned: 0 in 0.486s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634220979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e32b30-44b3-4a10-ad72-af709debe4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:30Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Creating volume b8e32b30-44b3-4a10-ad72-af709debe4f0 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:30 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb62dfd7-da0e-40f6-a5c9-135423bbcd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217377f3-8bf4-4376-94e6-498b7aac0919', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:30 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 1073741824 Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fb1361-11fc-4cd0-bf10-d3c8d29b73f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:30 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume volume-217377f3-8bf4-4376-94e6-498b7aac0919 (217377f3-8bf4-4376-94e6-498b7aac0919): created successfully Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fb1361-11fc-4cd0-bf10-d3c8d29b73f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (b9916044-9845-49a4-ba71-267f43503da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bb6d6fbc-119e-4786-979f-286513552e85 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created volume successfully. Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Flow 'volume_create_manager' (4716efae-ff06-4025-87ee-f6ec8df16366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ca58b1-6f85-4716-97c7-64c7c4b421b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ca58b1-6f85-4716-97c7-64c7c4b421b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-959436519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5cf907-49b5-4f84-941b-c2a519cbdf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38eecd19d494244827bc8962bd74ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:31Z,use_quota=True,user_id='64b2d050035e44159ff399ffdd69affd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88845e9b-020f-4dda-8b91-5be725b5d995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88845e9b-020f-4dda-8b91-5be725b5d995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4335a2e-ed66-4235-8f4f-2bac40c26e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4335a2e-ed66-4235-8f4f-2bac40c26e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5cf907-49b5-4f84-941b-c2a519cbdf3e', 'volume_name': 'volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66565216-ce82-4c0e-909a-dd05182eb5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66565216-ce82-4c0e-909a-dd05182eb5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e146311-490b-4f8f-af88-cf231c137af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Volume ba5cf907-49b5-4f84-941b-c2a519cbdf3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e', 'volume_size': 1} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (f1816f3e-84ed-4682-8002-8d5b75dfc831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f682dbba-3e49-4527-827b-359a792dfaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f682dbba-3e49-4527-827b-359a792dfaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871414989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:31Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6ca274-22a3-4eec-add4-e04cb1e0196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6ca274-22a3-4eec-add4-e04cb1e0196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7db8047-936a-46de-9cec-d7462d5fa43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7db8047-936a-46de-9cec-d7462d5fa43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1', 'volume_name': 'volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ce3ebd-e617-4cff-8db7-11c5729e04d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ce3ebd-e617-4cff-8db7-11c5729e04d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce40db0c-608e-45a7-bf7f-937d470d218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1', 'volume_size': 1} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:31 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (dcf18e51-bc3f-4bf1-86b0-18a136f9ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8599b1e3-ed85-4d36-9d6a-97aaf7ed4341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 1073741824" returned: 0 in 1.286s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8599b1e3-ed85-4d36-9d6a-97aaf7ed4341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-964356084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5815c4-a2b1-4537-a30f-4d0053c3fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:32Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e24f27b-2c8f-4230-91fb-0f508e199668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e24f27b-2c8f-4230-91fb-0f508e199668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2621fe41-765f-4d3d-8588-87acf10b0397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2621fe41-765f-4d3d-8588-87acf10b0397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5815c4-a2b1-4537-a30f-4d0053c3fb2d', 'volume_name': 'volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64cced6-edc2-4afc-95f8-22236e8295d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64cced6-edc2-4afc-95f8-22236e8295d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e179f5-edda-4f09-ac26-141a17f97348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume 0f5815c4-a2b1-4537-a30f-4d0053c3fb2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d', 'volume_size': 1} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:32 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 Sep 28 21:46:32 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (017911d2-6e81-4eb6-ace0-1c153ca6ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3c4830-327b-40b9-93db-ca74f6a4bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3c4830-327b-40b9-93db-ca74f6a4bcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1858492911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09025f84-ea15-42ef-8b3a-ec2e8ed6bb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:32Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12183f7f-75e8-4b7f-a9e9-f0fff8f5ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12183f7f-75e8-4b7f-a9e9-f0fff8f5ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41df649c-7d34-4ec1-aacb-cb80eee60d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41df649c-7d34-4ec1-aacb-cb80eee60d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09025f84-ea15-42ef-8b3a-ec2e8ed6bb98', 'volume_name': 'volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9959b118-b180-40ac-93e3-6b4c60901e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9959b118-b180-40ac-93e3-6b4c60901e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f55420d-c85c-4743-95a3-582e8b8d409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume 09025f84-ea15-42ef-8b3a-ec2e8ed6bb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98', 'volume_size': 1} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:32 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0" returned: 0 in 0.519s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-959436519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5cf907-49b5-4f84-941b-c2a519cbdf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38eecd19d494244827bc8962bd74ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:31Z,use_quota=True,user_id='64b2d050035e44159ff399ffdd69affd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Creating volume ba5cf907-49b5-4f84-941b-c2a519cbdf3e {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:32 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9445a7-203d-4d8d-b588-6d32a4bcec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e32b30-44b3-4a10-ad72-af709debe4f0', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e 1073741824 Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4aaf5a-6bf5-43a5-9042-d5d6e148e592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:32 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 (b8e32b30-44b3-4a10-ad72-af709debe4f0): created successfully Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4aaf5a-6bf5-43a5-9042-d5d6e148e592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (efbf11d0-c10e-46e2-86d8-fec62c69bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-40624422-d704-4c1a-8293-4467f47365e2 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created volume successfully. Sep 28 21:46:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-f6d2c3d8-64af-4378-b864-a93f1526907b req-9fc758ad-1584-4798-b084-b9f8f0349e49 tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:33 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e 1073741824" returned: 0 in 0.619s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:33 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e Sep 28 21:46:33 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:33 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" returned: 0 in 0.307s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871414989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:31Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Creating volume f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:33 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e146311-490b-4f8f-af88-cf231c137af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:33 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 1073741824 Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316f5849-c1e3-488f-95f0-3e2aeb908aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:33 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Volume volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e (ba5cf907-49b5-4f84-941b-c2a519cbdf3e): created successfully Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316f5849-c1e3-488f-95f0-3e2aeb908aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Flow 'volume_create_manager' (4716efae-ff06-4025-87ee-f6ec8df16366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:33 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-7a74ad73-a0b0-48b6-aeb1-eb803ae8cd81 req-09aecb03-5f2a-4d5c-83b5-372a9d1070f3 tempest-VolumesSnapshotsTestJSON-1500486361 None] Created volume successfully. Sep 28 21:46:34 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 1073741824" returned: 0 in 0.626s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:34 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 Sep 28 21:46:34 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:34 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1" returned: 0 in 0.289s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.534s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-964356084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5815c4-a2b1-4537-a30f-4d0053c3fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:32Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Creating volume 0f5815c4-a2b1-4537-a30f-4d0053c3fb2d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:34 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce40db0c-608e-45a7-bf7f-937d470d218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bdb9be-131d-4d1a-bec7-b5341156fb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:34 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d 1073741824 Sep 28 21:46:34 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:34 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 (f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1): created successfully Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bdb9be-131d-4d1a-bec7-b5341156fb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (f1816f3e-84ed-4682-8002-8d5b75dfc831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-13ab50ef-83b7-4e85-944e-baa4f84b6e9c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created volume successfully. Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:35 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d 1073741824" returned: 0 in 0.746s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:35 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d Sep 28 21:46:35 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:35 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d" returned: 0 in 0.300s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.382s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1858492911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09025f84-ea15-42ef-8b3a-ec2e8ed6bb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cd8ebb066344afb7d2b10bf45bd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:32Z,use_quota=True,user_id='79a1191ae3ef4dd3bd3a4e80d2f1ebc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Creating volume 09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:35 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:35 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 1073741824 Sep 28 21:46:35 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e179f5-edda-4f09-ac26-141a17f97348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3feefce-ca67-41f1-8893-a50a8d09c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:35 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d (0f5815c4-a2b1-4537-a30f-4d0053c3fb2d): created successfully Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3feefce-ca67-41f1-8893-a50a8d09c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (dcf18e51-bc3f-4bf1-86b0-18a136f9ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e2727b1f-86bb-4419-9b8d-3eb78a9e0f2c tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created volume successfully. Sep 28 21:46:36 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 1073741824" returned: 0 in 0.541s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:36 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 Sep 28 21:46:36 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:36 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98" returned: 0 in 0.278s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-f6d2c3d8-64af-4378-b864-a93f1526907b req-9fc758ad-1584-4798-b084-b9f8f0349e49 tempest-TestStampPattern-1833587336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.700s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f55420d-c85c-4743-95a3-582e8b8d409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841d5d1f-9c99-49c2-9121-e71de48e2890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-f6d2c3d8-64af-4378-b864-a93f1526907b req-9fc758ad-1584-4798-b084-b9f8f0349e49 tempest-TestStampPattern-1833587336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.605s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:36 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Volume volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 (09025f84-ea15-42ef-8b3a-ec2e8ed6bb98): created successfully Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841d5d1f-9c99-49c2-9121-e71de48e2890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Flow 'volume_create_manager' (017911d2-6e81-4eb6-ace0-1c153ca6ced3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Creating offline snapshot 5d931648-537c-4449-8654-2f91e3049d04 of volume ba5cf907-49b5-4f84-941b-c2a519cbdf3e {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:46:36 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d3ee5059-06ec-49e1-846c-6500db7633bc tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created volume successfully. Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd9cea4-cd3e-46b1-b1f3-4f5d804d8cac]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-f6d2c3d8-64af-4378-b864-a93f1526907b req-9fc758ad-1584-4798-b084-b9f8f0349e49 tempest-TestStampPattern-1833587336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-d788704d-e710-41d8-9e9b-e70e02bea719', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88523b97-6e02-42f0-a07a-c5c919fb633e', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:46:36 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-f6d2c3d8-64af-4378-b864-a93f1526907b req-9fc758ad-1584-4798-b084-b9f8f0349e49 tempest-TestStampPattern-1833587336 None] attachment_update completed successfully. Sep 28 21:46:36 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e Sep 28 21:46:36 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:37 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" returned: 0 in 0.508s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:37 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 1G Sep 28 21:46:37 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-quobyte-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8a65b-e6c8-49df-a023-a9d15354eae3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:37 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 1G" returned: 0 in 0.704s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:37 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 Sep 28 21:46:37 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:38 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 Sep 28 21:46:38 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:38 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04" returned: 0 in 0.406s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:38 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 is being set with open permissions: ugo+rw Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:38 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 Sep 28 21:46:38 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:38 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98" returned: 0 in 0.552s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:38 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98 Sep 28 21:46:38 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:38 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04" returned: 0 in 0.408s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:38 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98" returned: 0 in 0.321s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98" released by "delete_volume" :: held 0.962s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:38 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.info Sep 28 21:46:38 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created reservations ['4763bf31-e625-4e51-bb53-c88ddefa314d', 'de36d4d6-306e-4ec7-9087-29ff410fbd31', 'cec2ee0b-bdb8-4217-9593-3df04dc7978b', '04fee440-5e05-47b8-8e5a-3e7422d6d3bc'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:39 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:39 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:39 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.info" returned: 0 in 0.361s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:39 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.info is being set with open permissions: ugo+rw Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:39 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.info Sep 28 21:46:39 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:39 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.424s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Deleted volume successfully. Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-844f7bc1-579a-44e5-90a3-751ac19e264d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-09025f84-ea15-42ef-8b3a-ec2e8ed6bb98-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:39 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.info" returned: 0 in 0.374s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-414a76f2-170f-4736-b0c1-6e4220c4dd94 req-201db90e-5179-4573-b8c0-b96f51105f17 tempest-VolumesSnapshotsTestJSON-1500486361 None] Create snapshot completed successfully Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "cinder-5d931648-537c-4449-8654-2f91e3049d04-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-5d931648-537c-4449-8654-2f91e3049d04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "cinder-quobyte-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-quobyte-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "cinder-quobyte-5d931648-537c-4449-8654-2f91e3049d04" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-quobyte-5d931648-537c-4449-8654-2f91e3049d04" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Deleting offline snapshot 5d931648-537c-4449-8654-2f91e3049d04 of volume ba5cf907-49b5-4f84-941b-c2a519cbdf3e {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] snapshot_file for this snap is: volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef210bd-7e4e-4d22-8af9-020b315e692b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-quobyte-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:40 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 Sep 28 21:46:40 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7c6077-055f-41f3-9ba6-8884781b19ea]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:40 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d Sep 28 21:46:40 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:40 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-c5582482-26fb-4cbf-82b2-06ad27df0652 req-1cd0c7a0-7e4d-4007-a016-ae2208a8e2d2 tempest-TestStampPattern-1833587336 None] Terminate volume connection completed successfully. Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-c5582482-26fb-4cbf-82b2-06ad27df0652 req-1cd0c7a0-7e4d-4007-a016-ae2208a8e2d2 tempest-TestStampPattern-1833587336 None] Deleting attachment 88523b97-6e02-42f0-a07a-c5c919fb633e. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:46:40 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04" returned: 0 in 0.470s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[047a6990-8ca9-441f-a88f-485ff23d0515]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:40 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e Sep 28 21:46:40 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:40 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d" returned: 0 in 0.507s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:40 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d Sep 28 21:46:40 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:41 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" returned: 0 in 0.482s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:41 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 Sep 28 21:46:41 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:41 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d" returned: 0 in 0.390s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d" released by "delete_volume" :: held 0.979s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created reservations ['37bbcd3e-fe13-46e5-ab93-a8eb283f2968', '1b5925d0-059d-4ef6-b253-4a9cff5a3a7c', 'f605a2f0-fe7f-480e-be15-8a57b4f8e073', 'd99bb558-b820-4ee0-83cf-e1d747139e44'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:41 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:41 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:41 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04" returned: 0 in 0.494s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:41 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04 Sep 28 21:46:41 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:41 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:41 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Deleted volume successfully. Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5b19083c-dccd-46b6-8aa7-5ba5cf74487d tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-0f5815c4-a2b1-4537-a30f-4d0053c3fb2d-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:41 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e.5d931648-537c-4449-8654-2f91e3049d04" returned: 0 in 0.408s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-quobyte-5d931648-537c-4449-8654-2f91e3049d04" released by "_delete_snapshot" :: held 2.018s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-quobyte-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" released by "delete_snapshot" :: held 2.046s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.quota [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Created reservations ['0b02ace1-eb3d-4ed6-9038-acc25c958720', '180fa7f6-e610-4466-b1c5-b29551782292', '6e138817-33d5-43ca-90ed-059099e19e4e', 'dc782d0c-69cf-471e-bc17-4585b36847df'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Delete snapshot completed successfully. Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-ecd0da96-cdaa-477a-a951-a4fd172d0001 req-f763fab4-511f-4700-b88d-e4d0949fd571 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-5d931648-537c-4449-8654-2f91e3049d04-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "cinder-ba5cf907-49b5-4f84-941b-c2a519cbdf3e-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-ba5cf907-49b5-4f84-941b-c2a519cbdf3e-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "cinder-quobyte-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-quobyte-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-quobyte-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1" acquired by "delete_volume" :: waited 0.085s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[02423fdd-6dba-4906-86c4-912cfd6e6507]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8642b1-119f-4b43-bf44-d94e5e0f31b1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:43 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 Sep 28 21:46:43 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:43 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e Sep 28 21:46:43 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:43 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1" returned: 0 in 0.662s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:43 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1 Sep 28 21:46:43 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:43 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" returned: 0 in 0.740s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:43 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e Sep 28 21:46:43 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:43 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" returned: 0 in 0.400s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-quobyte-ba5cf907-49b5-4f84-941b-c2a519cbdf3e" released by "delete_volume" :: held 1.270s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:43 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1" returned: 0 in 0.504s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1" released by "delete_volume" :: held 1.251s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.quota [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Created reservations ['7ab898dc-69da-4423-8dd3-a94daac12588', 'f5ece64a-10ee-415d-8246-a76826b753ad', '4a1ce8b6-ad0b-4cbe-a076-12f2600bc660', '3760a2d1-00e3-4bd8-9d25-9ceff76ce6c8'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created reservations ['a104d603-00e7-4652-adf2-5e973785514e', '09a77bfb-7aad-45d8-bb7b-98cf369eda9a', 'aca5447c-831d-4578-9cdf-1c58c63321f0', 'e732c3e3-d514-4ec2-a1e6-ab40c1912226'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:44 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:44 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:44 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:44 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:44 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.376s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.manager [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:44 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Deleted volume successfully. Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [req-edba6e57-83f0-47e6-82b7-d2686dc7c57e req-03c644b5-c3f2-458f-a8d4-298c094fce30 tempest-VolumesSnapshotsTestJSON-1500486361 None] Lock "cinder-ba5cf907-49b5-4f84-941b-c2a519cbdf3e-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:44 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:44 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Deleted volume successfully. Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e8ba499d-2fb2-4c7e-8910-59dad7332a1a tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-f4178d9a-5fcc-4eb8-83f0-16e990d1b8a1-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-b8e32b30-44b3-4a10-ad72-af709debe4f0-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-b8e32b30-44b3-4a10-ad72-af709debe4f0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-quobyte-b8e32b30-44b3-4a10-ad72-af709debe4f0" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-b8e32b30-44b3-4a10-ad72-af709debe4f0" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c8fc66-f196-409b-b133-7deaa4c99433]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:45 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 Sep 28 21:46:45 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:45 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0" returned: 0 in 0.476s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:45 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0 Sep 28 21:46:45 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-d788704d-e710-41d8-9e9b-e70e02bea719-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Lock "cinder-d788704d-e710-41d8-9e9b-e70e02bea719-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-quobyte-d788704d-e710-41d8-9e9b-e70e02bea719" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-d788704d-e710-41d8-9e9b-e70e02bea719" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f2910-0d95-4767-85ec-6b9a388247f1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:45 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b8e32b30-44b3-4a10-ad72-af709debe4f0" returned: 0 in 0.321s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-b8e32b30-44b3-4a10-ad72-af709debe4f0" released by "delete_volume" :: held 0.865s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created reservations ['8554570f-875a-470a-b2c2-6eb63162316b', '4b713284-1bac-48f0-9da0-849bf475c9fa', '7e528664-6674-4f7c-95e8-1faaefc66f7e', '40da41f1-da5a-45d8-b8e3-4e30f0eaf2be'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:45 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 Sep 28 21:46:45 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:45 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:45 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-217377f3-8bf4-4376-94e6-498b7aac0919-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-217377f3-8bf4-4376-94e6-498b7aac0919-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-quobyte-217377f3-8bf4-4376-94e6-498b7aac0919" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:46 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-217377f3-8bf4-4376-94e6-498b7aac0919" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719" returned: 0 in 0.518s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1157c7b-34be-4483-bd6d-cf5be241ea1f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:46 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719 Sep 28 21:46:46 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:46 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.390s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Deleted volume successfully. Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-39ecc687-1dff-46d5-a9e0-5df0acf3b1cb tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-b8e32b30-44b3-4a10-ad72-af709debe4f0-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:46 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 Sep 28 21:46:46 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:46 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d788704d-e710-41d8-9e9b-e70e02bea719" returned: 0 in 0.339s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-d788704d-e710-41d8-9e9b-e70e02bea719" released by "delete_volume" :: held 0.922s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Created reservations ['422a3b7c-8917-4867-b9b5-458088bfaf91', 'c7bd6d2c-5510-4a2c-8055-0919f90f5c7c', 'ab01c032-991a-4dc7-b4c1-a79979458692', 'd00ba557-4dd6-4f10-bd84-501703c51db7'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:46 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919" returned: 0 in 0.474s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:46 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919 Sep 28 21:46:46 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:46 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:46 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:46 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-217377f3-8bf4-4376-94e6-498b7aac0919" returned: 0 in 0.288s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-217377f3-8bf4-4376-94e6-498b7aac0919" released by "delete_volume" :: held 0.830s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created reservations ['b205a91f-52de-4c95-ad89-e8fd53ab766c', '86e5ae61-b10c-4a0e-b9a0-452dd21598c7', '5bc8b7d0-8a5d-46ad-b479-4e1fd06837c6', '72b2b940-d931-4c22-945f-3fee72ad455b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:47 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.305s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Deleted volume successfully. Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-fe040d01-57e5-4561-8e25-330637371273 tempest-TestStampPattern-1833587336 None] Lock "cinder-d788704d-e710-41d8-9e9b-e70e02bea719-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:47 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:47 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "cinder-quobyte-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4" acquired by "delete_volume" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0206bf0f-a1b2-4b38-8a14-59a5ff8f01f7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:47 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.333s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Deleted volume successfully. Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cc981c3f-1628-4f18-ad69-ae490e66e475 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-217377f3-8bf4-4376-94e6-498b7aac0919-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:47 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 Sep 28 21:46:47 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:47 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4" returned: 0 in 0.456s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:47 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4 Sep 28 21:46:47 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-c7ba5d49-19cc-46e5-af34-5d1039196ae7-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Lock "cinder-c7ba5d49-19cc-46e5-af34-5d1039196ae7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-quobyte-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-quobyte-c7ba5d49-19cc-46e5-af34-5d1039196ae7" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-c7ba5d49-19cc-46e5-af34-5d1039196ae7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Deleting offline snapshot c7ba5d49-19cc-46e5-af34-5d1039196ae7 of volume 4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] snapshot_file for this snap is: volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:46:48 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4" returned: 0 in 0.370s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-quobyte-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4" released by "delete_volume" :: held 0.891s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6fb9c-f38d-4eef-bd54-822f37cc25f7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Created reservations ['f57a5ba7-6e2f-4ffd-8a13-b5b3254e420a', '48d874ca-fe14-4f76-9354-2214a8915cc6', 'b484c9e1-a3fd-4c01-baca-260e2821d220', '6b8a9982-6428-4015-a965-3e7de62ab3dd'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:48 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 Sep 28 21:46:48 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:48 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:48 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:48 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.334s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:48 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7" returned: 0 in 0.569s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:46:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Deleted volume successfully. Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[44298fae-8f12-4d6d-81eb-4226e6a5bedf]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a948b0ac-da94-4de0-a4a6-8e760d8fa295 tempest-CreateVolumesFromSourceVolumeTest-309792281 None] Lock "cinder-7f4f399d-e19b-41cf-9d3f-c4b68a3edee4-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:49 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 Sep 28 21:46:49 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:49 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" returned: 0 in 0.658s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:49 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 Sep 28 21:46:49 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:50 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7" returned: 0 in 0.503s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:50 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7 Sep 28 21:46:50 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:50 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9.c7ba5d49-19cc-46e5-af34-5d1039196ae7" returned: 0 in 0.427s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-c7ba5d49-19cc-46e5-af34-5d1039196ae7" released by "_delete_snapshot" :: held 2.370s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" released by "delete_snapshot" :: held 2.409s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:50 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Created reservations ['7fcb89ef-b322-478a-9f7d-949d845e6f73', '66217045-275d-402a-a568-f047a0dbad96', '9fd37b49-fec0-44d8-9161-01a481e6f24c', '42261c5b-363e-4383-9ada-1725e8d76399'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Delete snapshot completed successfully. Sep 28 21:46:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0c209819-1e87-49ce-a49e-e2667373f288 tempest-TestStampPattern-1833587336 None] Lock "cinder-c7ba5d49-19cc-46e5-af34-5d1039196ae7-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Flow 'volume_create_manager' (c1270ee6-1fcf-4544-840d-3a2a5d5affe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9d5233-d1dd-45e8-8d43-37753856c9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9d5233-d1dd-45e8-8d43-37753856c9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210655263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e976ad-197f-4dfa-9fd8-b26b63cf16cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797bbdb455be48c6bd867126567ff304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:54Z,use_quota=True,user_id='5e4225388dce46aab37692196f7a6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b1a71a-9b75-4db3-ad49-1f9953c744a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b1a71a-9b75-4db3-ad49-1f9953c744a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689325f7-96de-4b81-beea-9ce8c164d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689325f7-96de-4b81-beea-9ce8c164d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e976ad-197f-4dfa-9fd8-b26b63cf16cb', 'volume_name': 'volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78275e00-9f72-4db6-8a16-66e793c6e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78275e00-9f72-4db6-8a16-66e793c6e166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58132b5f-f39f-40bd-b73c-039cd8296029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:53 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Volume 77e976ad-197f-4dfa-9fd8-b26b63cf16cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb', 'volume_size': 1} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210655263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e976ad-197f-4dfa-9fd8-b26b63cf16cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797bbdb455be48c6bd867126567ff304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:46:54Z,use_quota=True,user_id='5e4225388dce46aab37692196f7a6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Creating volume 77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:46:53 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:46:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:53 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb 1073741824 Sep 28 21:46:53 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:54 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb 1073741824" returned: 0 in 0.653s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:54 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb Sep 28 21:46:54 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:54 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" returned: 0 in 0.324s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58132b5f-f39f-40bd-b73c-039cd8296029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd1e6d9-8094-429d-824f-c4e77e9c5979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:46:54 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Volume volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb (77e976ad-197f-4dfa-9fd8-b26b63cf16cb): created successfully Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd1e6d9-8094-429d-824f-c4e77e9c5979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:46:54 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Flow 'volume_create_manager' (c1270ee6-1fcf-4544-840d-3a2a5d5affe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:46:54 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b9786013-651f-42ad-bd5b-e9386de13c58 tempest-VolumeDependencyTests-1136593317 None] Created volume successfully. Sep 28 21:46:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:55 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Creating offline snapshot befc3885-ebb3-499f-a33c-f76e495e33b4 of volume 77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41ca00b-23ed-4e59-ac3a-ee595eaae495]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:56 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb Sep 28 21:46:56 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Lock "cinder-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Acquiring lock "cinder-quobyte-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[51453ed3-4cfc-4fbc-935e-937f5cddd4a2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:56 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" returned: 0 in 0.532s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:56 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 1G Sep 28 21:46:56 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:56 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 Sep 28 21:46:56 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:57 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" returned: 0 in 0.544s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:57 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9 Sep 28 21:46:57 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:57 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 1G" returned: 0 in 0.639s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:57 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 Sep 28 21:46:57 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:57 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" returned: 0 in 0.367s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Lock "cinder-quobyte-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9" released by "delete_volume" :: held 1.033s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Created reservations ['6ed0d979-102d-4076-a5c5-d0715501c5b8', '6590f332-a8aa-4785-a154-914a23f619a0', 'ba015b40-fbd7-4dd6-93b3-a4ea189f157b', 'd8f196ce-4c6d-4842-a9e6-d74cd75e86ea'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:57 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:46:57 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:57 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4" returned: 0 in 0.575s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:57 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 is being set with open permissions: ugo+rw Sep 28 21:46:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:57 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 Sep 28 21:46:57 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:58 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.372s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:46:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Deleted volume successfully. Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-392b1848-44d0-4fce-af77-8ea0c906d1bb tempest-TestStampPattern-1833587336 None] Lock "cinder-4986cfd5-fafe-4cea-a5e2-dd4883c1d9c9-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:46:58 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4" returned: 0 in 0.370s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:58 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.info Sep 28 21:46:58 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:58 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.info" returned: 0 in 0.299s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:58 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.info is being set with open permissions: ugo+rw Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:46:58 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.info Sep 28 21:46:58 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:46:58 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.info" returned: 0 in 0.305s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:46:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:46:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-dc81e5fe-4a84-4605-9ff1-4bdee9f5a64d tempest-VolumeDependencyTests-1136593317 None] Create snapshot completed successfully Sep 28 21:46:59 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:46:59 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Flow 'volume_create_manager' (b271d02a-4203-43e6-8f90-3622cb1f8d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a1bcf5-f576-40a9-a6a4-cfa01859e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a1bcf5-f576-40a9-a6a4-cfa01859e55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1816918855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddce1a1-724d-465e-8efe-90f0d22c189a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797bbdb455be48c6bd867126567ff304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=befc3885-ebb3-499f-a33c-f76e495e33b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:00Z,use_quota=True,user_id='5e4225388dce46aab37692196f7a6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7098f373-8e8a-4413-b912-eb7c0f19a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7098f373-8e8a-4413-b912-eb7c0f19a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae11e08a-b8ae-416a-9224-999741cdc42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae11e08a-b8ae-416a-9224-999741cdc42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eddce1a1-724d-465e-8efe-90f0d22c189a', 'volume_name': 'volume-eddce1a1-724d-465e-8efe-90f0d22c189a', 'volume_size': 1, 'snapshot_id': 'befc3885-ebb3-499f-a33c-f76e495e33b4'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8869988-5fe5-4afe-9f04-88a15fabd2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8869988-5fe5-4afe-9f04-88a15fabd2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a551ca-65d3-4025-971a-422b534a3f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:00 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Volume eddce1a1-724d-465e-8efe-90f0d22c189a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eddce1a1-724d-465e-8efe-90f0d22c189a', 'volume_size': 1, 'snapshot_id': 'befc3885-ebb3-499f-a33c-f76e495e33b4'} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-quobyte-befc3885-ebb3-499f-a33c-f76e495e33b4-eddce1a1-724d-465e-8efe-90f0d22c189a" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-befc3885-ebb3-499f-a33c-f76e495e33b4-eddce1a1-724d-465e-8efe-90f0d22c189a" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Creating volume eddce1a1-724d-465e-8efe-90f0d22c189a from snapshot befc3885-ebb3-499f-a33c-f76e495e33b4 {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-quobyte-eddce1a1-724d-465e-8efe-90f0d22c189a" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-eddce1a1-724d-465e-8efe-90f0d22c189a" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] snapshot: befc3885-ebb3-499f-a33c-f76e495e33b4, volume: eddce1a1-724d-465e-8efe-90f0d22c189a, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff2d55-437e-4dcb-bb1e-aa49af4a03ef]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:00 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 Sep 28 21:47:00 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-757e4024-dff1-45f7-888e-ec847c352c9a tempest-GroupsV314Test-498382476 None] Group tempest-GroupsV314Test-Group-674754885: creating Sep 28 21:47:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-757e4024-dff1-45f7-888e-ec847c352c9a tempest-GroupsV314Test-498382476 None] Group tempest-GroupsV314Test-Group-674754885: created successfully Sep 28 21:47:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-757e4024-dff1-45f7-888e-ec847c352c9a tempest-GroupsV314Test-498382476 None] Create group completed successfully. Sep 28 21:47:00 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4" returned: 0 in 0.618s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[04edbc20-798c-410a-87a2-7a0131427fde]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:01 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb Sep 28 21:47:01 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:01 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" returned: 0 in 0.463s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:47:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:47:01 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:47:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:01 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a Sep 28 21:47:01 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Flow 'volume_create_manager' (7e8a3cfe-54a4-4f72-8ec3-e257e54d709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b02f2c-17e7-43a9-ad43-b80b961a6e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b02f2c-17e7-43a9-ad43-b80b961a6e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-138043671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3039d3f-0bda-41ea-bd1a-5494ab7c6e9b,host='devstack@QuobyteHD#QuobyteHD',id=443a4cd2-a696-4e29-9f62-a1a1a9a0315a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cefe243791b4c95b67eb19855eadb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:03Z,use_quota=True,user_id='021b294b0a554de9a2762c164ad0f688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10667045-5d32-4bf7-ad4d-56e56d2d0b53),volume_type_id=10667045-5d32-4bf7-ad4d-56e56d2d0b53)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a22aed-6e68-4831-95df-e17417175fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a22aed-6e68-4831-95df-e17417175fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6884ab49-9909-4a0f-aaf0-710c76d56b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6884ab49-9909-4a0f-aaf0-710c76d56b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443a4cd2-a696-4e29-9f62-a1a1a9a0315a', 'volume_name': 'volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4434d88-7f9e-4f32-98ce-216c13741489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4434d88-7f9e-4f32-98ce-216c13741489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d778011-2e48-49ad-bf01-d17c51b7d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:03 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Volume 443a4cd2-a696-4e29-9f62-a1a1a9a0315a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a', 'volume_size': 1} Sep 28 21:47:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:47:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:07 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:07 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:08 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.546s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:08 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:47:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:47:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:47:10 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a" returned: 0 in 8.779s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:47:10 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Converted 1024.00 MB image at 116.61 MB/s Sep 28 21:47:10 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a is being set with open permissions: ugo+rw Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:10 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a Sep 28 21:47:10 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:10 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a" returned: 0 in 0.274s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-eddce1a1-724d-465e-8efe-90f0d22c189a" released by "_copy_volume_from_snapshot" :: held 10.293s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=149,cinder:SELECT=138,cinder:INSERT=40,cinder:DELETE=15 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=118,cinder:INSERT=42,cinder:UPDATE=161,cinder:DELETE=10 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-befc3885-ebb3-499f-a33c-f76e495e33b4-eddce1a1-724d-465e-8efe-90f0d22c189a" released by "_create_volume_from_snapshot" :: held 10.392s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.414s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.857s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3039d3f-0bda-41ea-bd1a-5494ab7c6e9b,created_at=2026-09-28T19:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-138043671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3039d3f-0bda-41ea-bd1a-5494ab7c6e9b,host='devstack@QuobyteHD#QuobyteHD',id=443a4cd2-a696-4e29-9f62-a1a1a9a0315a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cefe243791b4c95b67eb19855eadb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:03Z,use_quota=True,user_id='021b294b0a554de9a2762c164ad0f688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10667045-5d32-4bf7-ad4d-56e56d2d0b53),volume_type_id=10667045-5d32-4bf7-ad4d-56e56d2d0b53)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Creating volume 443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:10 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:10 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a 1073741824 Sep 28 21:47:10 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a551ca-65d3-4025-971a-422b534a3f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddce1a1-724d-465e-8efe-90f0d22c189a', 'volume_size': 1, 'snapshot_id': 'befc3885-ebb3-499f-a33c-f76e495e33b4'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ddc3da-37df-4d15-9cb2-1cec3279f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:10 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Volume volume-eddce1a1-724d-465e-8efe-90f0d22c189a (eddce1a1-724d-465e-8efe-90f0d22c189a): created successfully Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ddc3da-37df-4d15-9cb2-1cec3279f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Flow 'volume_create_manager' (b271d02a-4203-43e6-8f90-3622cb1f8d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8e403bfe-ead6-4df2-bf7c-9d68b5f7f98d tempest-VolumeDependencyTests-1136593317 None] Created volume successfully. Sep 28 21:47:11 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a 1073741824" returned: 0 in 0.592s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-befc3885-ebb3-499f-a33c-f76e495e33b4-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:11 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a Sep 28 21:47:11 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-befc3885-ebb3-499f-a33c-f76e495e33b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-quobyte-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-quobyte-befc3885-ebb3-499f-a33c-f76e495e33b4" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-befc3885-ebb3-499f-a33c-f76e495e33b4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Deleting offline snapshot befc3885-ebb3-499f-a33c-f76e495e33b4 of volume 77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] snapshot_file for this snap is: volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8caaf7-1893-4b95-b4a6-f6668da7e1e1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:11 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 Sep 28 21:47:11 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:11 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" returned: 0 in 0.305s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d778011-2e48-49ad-bf01-d17c51b7d458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296549d5-9c29-473b-9be3-1118a86d725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:11 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Volume volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a (443a4cd2-a696-4e29-9f62-a1a1a9a0315a): created successfully Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296549d5-9c29-473b-9be3-1118a86d725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Flow 'volume_create_manager' (7e8a3cfe-54a4-4f72-8ec3-e257e54d709a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c496e4c0-16b7-43b7-a92d-c0900c668eb8 tempest-GroupsV314Test-498382476 None] Created volume successfully. Sep 28 21:47:11 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4" returned: 0 in 0.369s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f0a93-c333-4f3a-b184-71382498556b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:11 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb Sep 28 21:47:11 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:12 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" returned: 0 in 0.623s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:12 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 Sep 28 21:47:12 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:12 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4" returned: 0 in 0.435s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:12 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4 Sep 28 21:47:12 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:13 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Cloning volume 443a4cd2-a696-4e29-9f62-a1a1a9a0315a to volume 6b4a77af-ddf7-4816-8f84-c87e0c024a35 Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Creating offline snapshot 4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 of volume 443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:47:13 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb.befc3885-ebb3-499f-a33c-f76e495e33b4" returned: 0 in 0.332s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8db3c64-deea-4e6d-8769-45b05506de6f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-befc3885-ebb3-499f-a33c-f76e495e33b4" released by "_delete_snapshot" :: held 1.948s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" released by "delete_snapshot" :: held 1.981s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Created reservations ['c52337a4-211d-4da7-8b4b-581d4b4b2e2b', '64c4db71-cad8-40d1-84e1-854abf0c9f63', 'e97ed125-8ed1-4f6e-bff8-fab99ba61b13', '087580d8-f94c-4d90-9601-9b036913b49a'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:13 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a Sep 28 21:47:13 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:13 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Delete snapshot completed successfully. Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7cde6c90-8b6d-4918-9b84-936860b8645a tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-befc3885-ebb3-499f-a33c-f76e495e33b4-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:13 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" returned: 0 in 0.648s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:13 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 1G Sep 28 21:47:13 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:14 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 1G" returned: 0 in 0.568s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:14 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 Sep 28 21:47:14 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-77e976ad-197f-4dfa-9fd8-b26b63cf16cb-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-77e976ad-197f-4dfa-9fd8-b26b63cf16cb-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-quobyte-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" acquired by "delete_volume" :: waited 0.035s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb10d128-6de1-405e-82d0-f4c96d4063c7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:14 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" returned: 0 in 0.510s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:14 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:47:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:14 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 Sep 28 21:47:14 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:14 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb Sep 28 21:47:14 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:15 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" returned: 0 in 0.487s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:15 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" returned: 0 in 0.606s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:15 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.info Sep 28 21:47:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:15 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:15 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb Sep 28 21:47:15 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:15 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.info" returned: 0 in 0.458s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:15 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:47:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:15 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.info Sep 28 21:47:15 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:15 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" returned: 0 in 0.499s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-77e976ad-197f-4dfa-9fd8-b26b63cf16cb" released by "delete_volume" :: held 1.245s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Created reservations ['8ad3239f-3f32-43aa-9d7a-2fdf5343b8db', 'b61b17cb-31a5-4b00-82c0-937b6be06cc6', '1fc1a949-153a-4c05-9585-93c222192dbd', '90b17724-5a76-4f1b-bc41-1b0732dae955'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:16 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.info" returned: 0 in 0.380s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Acquiring lock "cinder-quobyte-6b4a77af-ddf7-4816-8f84-c87e0c024a35" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:16 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:16 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Lock "cinder-quobyte-6b4a77af-ddf7-4816-8f84-c87e0c024a35" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] snapshot: 4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114, volume: 6b4a77af-ddf7-4816-8f84-c87e0c024a35, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4965fa62-6060-4bb5-ac2e-6ef119c19a16]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-9de06f31-e152-42a1-a4b9-d96a01df27f8 req-2ba20d6d-a9d0-470a-ac2c-587496ab798e tempest-TestMinimumBasicScenario-1942971503 None] Terminate volume connection completed successfully. Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-9de06f31-e152-42a1-a4b9-d96a01df27f8 req-2ba20d6d-a9d0-470a-ac2c-587496ab798e tempest-TestMinimumBasicScenario-1942971503 None] Deleting attachment 5afcb4d1-3aec-4ae3-b020-deed85785f9b. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:47:16 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 Sep 28 21:47:16 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:16 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.376s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Deleted volume successfully. Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-85c4b156-ee86-4e6f-bd95-41cb81128ca8 tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-77e976ad-197f-4dfa-9fd8-b26b63cf16cb-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:16 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-eddce1a1-724d-465e-8efe-90f0d22c189a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" returned: 0 in 0.606s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[23000ce1-bb7b-46de-ab68-1d87a21efbfa]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-eddce1a1-724d-465e-8efe-90f0d22c189a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Acquiring lock "cinder-7508aa9b-1257-4d5d-96ab-70610fd813f1-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "cinder-quobyte-eddce1a1-724d-465e-8efe-90f0d22c189a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Lock "cinder-7508aa9b-1257-4d5d-96ab-70610fd813f1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-eddce1a1-724d-465e-8efe-90f0d22c189a" acquired by "delete_volume" :: waited 0.050s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[755ba80d-c825-4718-98b4-9bb3afceff2a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:17 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a Sep 28 21:47:17 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Acquiring lock "cinder-quobyte-7508aa9b-1257-4d5d-96ab-70610fd813f1" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Lock "cinder-quobyte-7508aa9b-1257-4d5d-96ab-70610fd813f1" acquired by "delete_volume" :: waited 0.036s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d24b84a-3b86-490a-b045-a27c0ca9ef0e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:17 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a Sep 28 21:47:17 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:17 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 Sep 28 21:47:17 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:17 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" returned: 0 in 0.642s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:17 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 Sep 28 21:47:17 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:17 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:17 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a" returned: 0 in 0.570s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1" returned: 0 in 0.469s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:17 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a Sep 28 21:47:17 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:17 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1 Sep 28 21:47:17 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:18 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eddce1a1-724d-465e-8efe-90f0d22c189a" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-quobyte-eddce1a1-724d-465e-8efe-90f0d22c189a" released by "delete_volume" :: held 0.924s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:18 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7508aa9b-1257-4d5d-96ab-70610fd813f1" returned: 0 in 0.303s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Lock "cinder-quobyte-7508aa9b-1257-4d5d-96ab-70610fd813f1" released by "delete_volume" :: held 0.847s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Created reservations ['80445deb-c365-4c4d-bdd5-1f086af6ee20', 'bc0ff232-b74c-4ed3-9156-6cf0d7965f07', '05f9c843-4f82-42d0-97b1-a9f4b7e56cc1', 'a12f7d46-a6ae-4d62-80aa-9125ea05a200'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Created reservations ['d9857c27-7961-44e5-8103-e1a0b61e6a11', 'c99280a0-0adb-4c5d-a883-6f0d0e9a2e01', '0b06d2a5-4b79-4e6d-92d5-7484657e4d90', '7ae1fa28-abec-4295-b883-07fdaa44a308'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:18 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:18 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:18 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:18 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (85954f81-0ca5-45fd-aae8-fac1709fbd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecb304b-fb0a-487e-8d9b-4c079c5f3ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:18 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecb304b-fb0a-487e-8d9b-4c079c5f3ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309819459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92a2f47-c452-409d-b5a6-ad69f8e1d098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:19Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99556b5-0efe-4f59-9660-7b08056b4367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99556b5-0efe-4f59-9660-7b08056b4367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d1f61f-5c36-4092-8158-6101f6e4ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d1f61f-5c36-4092-8158-6101f6e4ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92a2f47-c452-409d-b5a6-ad69f8e1d098', 'volume_name': 'volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a707ba-1646-41cc-9143-ec3ec7d35126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a707ba-1646-41cc-9143-ec3ec7d35126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c5e45a-3fef-4354-8697-9ec551d5e316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:18 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Volume a92a2f47-c452-409d-b5a6-ad69f8e1d098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098', 'volume_size': 1} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.614s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:18 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:18 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Deleted volume successfully. Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-27f0954b-96cf-43e2-9d5b-871a5e465ee2 tempest-VolumeDependencyTests-1136593317 None] Lock "cinder-eddce1a1-724d-465e-8efe-90f0d22c189a-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:19 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.553s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Deleted volume successfully. Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7b7229e4-5638-4488-827b-4f0371739784 tempest-TestMinimumBasicScenario-1942971503 None] Lock "cinder-7508aa9b-1257-4d5d-96ab-70610fd813f1-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (658a40d5-e0a0-4ed6-acb9-dd5939e132d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22acfb1-dbaf-4ddb-85f2-6366bea5ba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22acfb1-dbaf-4ddb-85f2-6366bea5ba69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1135497032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdf9561-34ff-49e4-87c3-7c9cb2820472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:20Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80418a2-3187-4278-b24c-8ea1e15bf2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:19 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80418a2-3187-4278-b24c-8ea1e15bf2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9da003-0e33-4d3e-a4ee-6830407b5a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9da003-0e33-4d3e-a4ee-6830407b5a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdf9561-34ff-49e4-87c3-7c9cb2820472', 'volume_name': 'volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb19e394-c49c-4f28-a35f-07c4749abc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb19e394-c49c-4f28-a35f-07c4749abc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b363d0b-7a18-44db-8e20-668bef0090ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:20 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Volume 6bdf9561-34ff-49e4-87c3-7c9cb2820472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472', 'volume_size': 1} Sep 28 21:47:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (5f2bb332-2726-4cca-81ac-a74f00eafba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c421be07-882f-4ac6-b81c-36d5a612ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c421be07-882f-4ac6-b81c-36d5a612ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-619997868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:21Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3da3e3-8201-41f3-a5f1-6e02d8a282e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3da3e3-8201-41f3-a5f1-6e02d8a282e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21e0e1d-c531-4c6a-93be-018aa415aa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21e0e1d-c531-4c6a-93be-018aa415aa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62', 'volume_name': 'volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91d1d07-e040-417d-afb4-7e897be644a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91d1d07-e040-417d-afb4-7e897be644a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda889f5-04ca-47b6-ba16-ede2e78a8521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Volume d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62', 'volume_size': 1} Sep 28 21:47:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (439a32f8-7b4b-444f-a3c3-269438de5173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0955736f-fd3a-494a-9d13-87233066391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0955736f-fd3a-494a-9d13-87233066391a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1043769809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb42c363-243f-4dcc-83c1-bb0ca2d47df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:22Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7f715d-8639-47f8-8686-5e9232e10d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7f715d-8639-47f8-8686-5e9232e10d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87198fed-8496-4e02-ac8e-a4ee3796038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87198fed-8496-4e02-ac8e-a4ee3796038c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb42c363-243f-4dcc-83c1-bb0ca2d47df9', 'volume_name': 'volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc1293b-2176-4a74-94b8-f258f3b5ed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc1293b-2176-4a74-94b8-f258f3b5ed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b7e724-edca-40c4-a9a7-165c92e50bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Volume bb42c363-243f-4dcc-83c1-bb0ca2d47df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9', 'volume_size': 1} Sep 28 21:47:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (cef43ee1-ee89-459b-a5f1-a90113369403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be266b58-3139-4c94-8ac4-b56fcc5b7db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be266b58-3139-4c94-8ac4-b56fcc5b7db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1039709807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:23Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1ffe14-46f9-4e5d-b170-30a7601d4511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1ffe14-46f9-4e5d-b170-30a7601d4511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75d199c-2b64-4df3-b01d-c74bea385f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75d199c-2b64-4df3-b01d-c74bea385f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2', 'volume_name': 'volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8225bba7-1633-4ba2-a528-97776c989b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8225bba7-1633-4ba2-a528-97776c989b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b47978-3532-4e8d-9c8b-e641466de2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:23 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Volume e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2', 'volume_size': 1} Sep 28 21:47:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:27 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35" returned: 0 in 9.798s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a, size 1024.00 MB, duration 9.80 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:47:27 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Converted 1024.00 MB image at 104.47 MB/s Sep 28 21:47:27 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:27 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 Sep 28 21:47:27 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Flow 'volume_create_manager' (e7e268d8-0111-49e1-9a24-aca675549b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da187470-7d2c-4cf3-a750-cd7d30fc0d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da187470-7d2c-4cf3-a750-cd7d30fc0d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149772e2-a5f2-425d-ac7f-957599b0111b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e660e91afbc46df861d852f4a34755e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:28Z,use_quota=True,user_id='a01a624b9fca4af8b707a208676d6f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf6e87c-310e-45e1-b007-59cad81dd35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf6e87c-310e-45e1-b007-59cad81dd35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dec5c6-a927-4b24-9609-50bc04efc455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dec5c6-a927-4b24-9609-50bc04efc455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149772e2-a5f2-425d-ac7f-957599b0111b', 'volume_name': 'volume-149772e2-a5f2-425d-ac7f-957599b0111b', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7e873e-0d7e-41b5-8023-f3a9e4b06bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7e873e-0d7e-41b5-8023-f3a9e4b06bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5c88c1-f947-4b65-bacc-e304c065523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Volume 149772e2-a5f2-425d-ac7f-957599b0111b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149772e2-a5f2-425d-ac7f-957599b0111b', 'volume_size': 1} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:27 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Lock "cinder-quobyte-6b4a77af-ddf7-4816-8f84-c87e0c024a35" released by "_copy_volume_from_snapshot" :: held 11.552s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Acquiring lock "cinder-quobyte-4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Lock "cinder-quobyte-4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Deleting offline snapshot 4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 of volume 443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] snapshot_file for this snap is: volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04c8096-2786-4224-918f-4edc5920949d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:28 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 Sep 28 21:47:28 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:28 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" returned: 0 in 0.393s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:47:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[342dfb0f-4f10-4a73-bf85-89cc3e0ed250]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:28 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a Sep 28 21:47:28 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:28 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" returned: 0 in 0.585s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:28 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 Sep 28 21:47:28 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:29 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" returned: 0 in 0.333s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:29 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114 Sep 28 21:47:29 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:29 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a.4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" returned: 0 in 0.270s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Lock "cinder-quobyte-4aa70d0d-e7e2-4b68-a7be-2dd27cf1c114" released by "_delete_snapshot" :: held 1.693s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.540s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.574s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309819459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92a2f47-c452-409d-b5a6-ad69f8e1d098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:19Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Creating volume a92a2f47-c452-409d-b5a6-ad69f8e1d098 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:29 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:29 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 1073741824 Sep 28 21:47:29 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f086bca4-4574-4501-bef2-fe4624902edd tempest-GroupsV314Test-498382476 None] Create group from source-group-a3039d3f-0bda-41ea-bd1a-5494ab7c6e9b completed successfully. Sep 28 21:47:30 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 1073741824" returned: 0 in 0.589s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:30 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 Sep 28 21:47:30 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Acquiring lock "cinder-quobyte-6b4a77af-ddf7-4816-8f84-c87e0c024a35" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:30 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Lock "cinder-quobyte-6b4a77af-ddf7-4816-8f84-c87e0c024a35" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098" returned: 0 in 0.342s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.422s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1135497032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdf9561-34ff-49e4-87c3-7c9cb2820472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:20Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Creating volume 6bdf9561-34ff-49e4-87c3-7c9cb2820472 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:30 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd77ac1-70bd-476e-8f8a-f50d6ce4784d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:30 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 1073741824 Sep 28 21:47:30 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c5e45a-3fef-4354-8697-9ec551d5e316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa94da6-a002-429e-8d23-3c04b834c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Volume volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 (a92a2f47-c452-409d-b5a6-ad69f8e1d098): created successfully Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa94da6-a002-429e-8d23-3c04b834c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (85954f81-0ca5-45fd-aae8-fac1709fbd5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c00594a5-7e84-4b18-9826-dc825a6abcfa tempest-CreateVolumesFromImageTest-1283768098 None] Created volume successfully. Sep 28 21:47:30 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 Sep 28 21:47:30 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:31 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35" returned: 0 in 0.551s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:31 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35 Sep 28 21:47:31 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:31 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 1073741824" returned: 0 in 0.614s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:31 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 Sep 28 21:47:31 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:31 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6b4a77af-ddf7-4816-8f84-c87e0c024a35" returned: 0 in 0.282s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Lock "cinder-quobyte-6b4a77af-ddf7-4816-8f84-c87e0c024a35" released by "delete_volume" :: held 0.941s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:31 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472" returned: 0 in 0.274s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.124s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-619997868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:21Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Creating volume d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:31 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:31 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 1073741824 Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b363d0b-7a18-44db-8e20-668bef0090ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:31 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89881105-fcf0-40c0-a0df-23dff80ff4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Volume volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 (6bdf9561-34ff-49e4-87c3-7c9cb2820472): created successfully Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89881105-fcf0-40c0-a0df-23dff80ff4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (658a40d5-e0a0-4ed6-acb9-dd5939e132d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ebe925e7-f330-48f7-80e3-b5a42546c04c tempest-CreateVolumesFromImageTest-1283768098 None] Created volume successfully. Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Created reservations ['aa2c898e-0f6c-42b2-a846-3e744305e43d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:31 devstack cinder-volume[86489]: WARNING cinder.quota [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1606490643 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1606490643, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:47:31 devstack cinder-volume[86489]: WARNING cinder.quota [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1606490643 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1606490643, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Created reservations ['9c69202d-60ad-4e2e-a95c-aca2035368c9', '7f5a7b7b-74de-4177-abcd-f7e0367e4240', '57358d33-a9eb-4f4c-9a21-5e2dc4d23085', 'abe10b91-7ed2-4680-a2c6-04cc91aacca4'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:31 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:31 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:32 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 1073741824" returned: 0 in 0.567s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:32 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 Sep 28 21:47:32 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:32 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.338s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-328253e2-08a9-4d1c-b153-0173767f121e tempest-GroupsV314Test-498382476 None] Delete group completed successfully. Sep 28 21:47:32 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62" returned: 0 in 0.261s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.802s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1043769809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb42c363-243f-4dcc-83c1-bb0ca2d47df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:22Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Creating volume bb42c363-243f-4dcc-83c1-bb0ca2d47df9 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:32 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:32 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 1073741824 Sep 28 21:47:32 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda889f5-04ca-47b6-ba16-ede2e78a8521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c05e1c-fd09-49fc-a0f2-20545c71058d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Volume volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 (d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62): created successfully Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c05e1c-fd09-49fc-a0f2-20545c71058d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (5f2bb332-2726-4cca-81ac-a74f00eafba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-692e15d0-23db-4cdf-a6b0-0326df4742fa tempest-CreateVolumesFromImageTest-1283768098 None] Created volume successfully. Sep 28 21:47:32 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 1073741824" returned: 0 in 0.529s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:32 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 Sep 28 21:47:32 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Acquiring lock "cinder-quobyte-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Lock "cinder-quobyte-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a93ac6-1037-4cd5-87bf-4baefbd23b50]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:33 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9" returned: 0 in 0.322s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.649s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1039709807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e858b9c1d948dfb3d652d3f2bd5c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:23Z,use_quota=True,user_id='17cd6d92498d4558a1f77c4fd7b42971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Creating volume e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:33 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b7e724-edca-40c4-a9a7-165c92e50bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede96f48-04dd-4b60-b37d-bdf45fb7bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:33 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 1073741824 Sep 28 21:47:33 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Volume volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 (bb42c363-243f-4dcc-83c1-bb0ca2d47df9): created successfully Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede96f48-04dd-4b60-b37d-bdf45fb7bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (439a32f8-7b4b-444f-a3c3-269438de5173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:33 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-feeb27f6-8116-434b-be69-e18f9a38f91b tempest-CreateVolumesFromImageTest-1283768098 None] Created volume successfully. Sep 28 21:47:33 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a Sep 28 21:47:33 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:33 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" returned: 0 in 0.442s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:33 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a Sep 28 21:47:33 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:33 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 1073741824" returned: 0 in 0.501s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:33 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 Sep 28 21:47:33 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:33 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" returned: 0 in 0.313s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Lock "cinder-quobyte-443a4cd2-a696-4e29-9f62-a1a1a9a0315a" released by "delete_volume" :: held 0.833s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Created reservations ['5421e31d-0e81-43b1-9f51-08da3d4afd0d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:34 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2" returned: 0 in 0.306s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.407s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149772e2-a5f2-425d-ac7f-957599b0111b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e660e91afbc46df861d852f4a34755e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:28Z,use_quota=True,user_id='a01a624b9fca4af8b707a208676d6f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Creating volume 149772e2-a5f2-425d-ac7f-957599b0111b {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:34 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:34 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b 1073741824 Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b47978-3532-4e8d-9c8b-e641466de2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:34 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ce9ca8-a694-4ac5-854d-e59e8b2957ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:34 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Volume volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 (e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2): created successfully Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ce9ca8-a694-4ac5-854d-e59e8b2957ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Flow 'volume_create_manager' (cef43ee1-ee89-459b-a5f1-a90113369403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Created reservations ['100bd394-168d-4973-af10-83fc54d9216f', '70bae0a1-4602-4258-a0ec-fd51c7f4a3df', '475c471f-37fc-4f55-8529-c1abe0ad21ed', 'de79a181-0a43-4a35-8127-2f8f598b676a'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ad776cab-d9b9-4af6-a6d6-c1022ee89ae0 tempest-CreateVolumesFromImageTest-1283768098 None] Created volume successfully. Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:34 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:34 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:34 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.304s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-257f5b12-72ae-4802-a7d2-98f316a873a3 tempest-GroupsV314Test-498382476 None] Delete group completed successfully. Sep 28 21:47:34 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b 1073741824" returned: 0 in 0.516s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:34 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b Sep 28 21:47:34 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:35 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b" returned: 0 in 0.308s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5c88c1-f947-4b65-bacc-e304c065523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149772e2-a5f2-425d-ac7f-957599b0111b', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939699ea-acc4-460f-b9b8-5d3eb9ff84ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:35 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Volume volume-149772e2-a5f2-425d-ac7f-957599b0111b (149772e2-a5f2-425d-ac7f-957599b0111b): created successfully Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939699ea-acc4-460f-b9b8-5d3eb9ff84ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Flow 'volume_create_manager' (e7e268d8-0111-49e1-9a24-aca675549b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-342d5214-c61a-4256-8f9e-cb190c4441f2 tempest-CinderUnicodeTest-1636315432 None] Created volume successfully. Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-quobyte-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[062e53cd-4567-4bb3-8598-939306e3647c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:35 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 Sep 28 21:47:35 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:35 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2" returned: 0 in 0.447s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:35 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2 Sep 28 21:47:35 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:36 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2" returned: 0 in 0.338s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2" released by "delete_volume" :: held 0.834s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Created reservations ['89e83d41-eeeb-49cb-a790-87a397056032', '161da4fc-e4d3-4c76-9653-8e2c3d6a797d', '731ddf4a-bcb7-4755-8b07-a180464a2210', '5c6e7047-63a4-47d0-af16-a2e2be3d4573'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:36 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:36 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-bb42c363-243f-4dcc-83c1-bb0ca2d47df9-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-bb42c363-243f-4dcc-83c1-bb0ca2d47df9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-quobyte-bb42c363-243f-4dcc-83c1-bb0ca2d47df9" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-bb42c363-243f-4dcc-83c1-bb0ca2d47df9" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2385c0ec-4e51-4092-a364-37f7ac568a38]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:36 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.459s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:36 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:36 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Deleted volume successfully. Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f6f3f932-914e-4afe-b408-081f3da2b811 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-e40fdd4b-f2e1-4701-9759-1d2d5b14f9c2-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:37 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 Sep 28 21:47:37 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Flow 'volume_create_manager' (68d98cb6-43a3-4726-920d-f3b313ce5af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c146f89-f389-48d7-9006-ca1269e076c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c146f89-f389-48d7-9006-ca1269e076c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-82552571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c71c37b-bb68-4a95-a24b-80b7f50322ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e660e91afbc46df861d852f4a34755e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:37Z,use_quota=True,user_id='a01a624b9fca4af8b707a208676d6f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7800870-cb0f-4cee-91e7-abf3b0b26b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7800870-cb0f-4cee-91e7-abf3b0b26b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e08726-8e86-4e8c-ab88-4a60a247157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e08726-8e86-4e8c-ab88-4a60a247157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c71c37b-bb68-4a95-a24b-80b7f50322ae', 'volume_name': 'volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983e9c4d-e9cc-4fe1-85d0-76072156e280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983e9c4d-e9cc-4fe1-85d0-76072156e280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551e1a62-daf6-4b25-b526-73ca075433b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:37 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Volume 0c71c37b-bb68-4a95-a24b-80b7f50322ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae', 'volume_size': 1} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-82552571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c71c37b-bb68-4a95-a24b-80b7f50322ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e660e91afbc46df861d852f4a34755e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:37Z,use_quota=True,user_id='a01a624b9fca4af8b707a208676d6f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Creating volume 0c71c37b-bb68-4a95-a24b-80b7f50322ae {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:37 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:37 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae 1073741824 Sep 28 21:47:37 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:37 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9" returned: 0 in 0.517s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:37 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9 Sep 28 21:47:37 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:37 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bb42c363-243f-4dcc-83c1-bb0ca2d47df9" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-bb42c363-243f-4dcc-83c1-bb0ca2d47df9" released by "delete_volume" :: held 0.929s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:37 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Created reservations ['35326d7e-2b39-4fb6-918e-8b3738527d8f', '71d0ae87-b0cf-4fe8-aa9c-4ba02ddbbffe', 'f87ad10b-63a9-49b9-a482-6f54eb4a3ee0', '18e7f958-f76b-4bc1-8ac6-08c97bf2cfd6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae 1073741824" returned: 0 in 0.633s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:37 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae Sep 28 21:47:37 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:37 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:37 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:38 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae" returned: 0 in 0.304s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551e1a62-daf6-4b25-b526-73ca075433b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dc0bdc-6cf5-4314-9691-d39b8d8b0bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:38 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Volume volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae (0c71c37b-bb68-4a95-a24b-80b7f50322ae): created successfully Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dc0bdc-6cf5-4314-9691-d39b8d8b0bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Flow 'volume_create_manager' (68d98cb6-43a3-4726-920d-f3b313ce5af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f397b301-0959-4a22-a39c-dccc6d88d9ac tempest-CinderUnicodeTest-1636315432 None] Created volume successfully. Sep 28 21:47:38 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.328s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Deleted volume successfully. Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1dde1ae1-563f-4285-9bff-2e30bab169e6 tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-bb42c363-243f-4dcc-83c1-bb0ca2d47df9-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-quobyte-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3203b47e-c527-44d5-8531-e31979047827]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:39 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 Sep 28 21:47:39 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Creating offline snapshot e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 of volume 0c71c37b-bb68-4a95-a24b-80b7f50322ae {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbac8af8-a304-40ad-9b20-b4d8c4a2033d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:39 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62" returned: 0 in 0.489s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:39 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62 Sep 28 21:47:39 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:39 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae Sep 28 21:47:39 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:39 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62" returned: 0 in 0.293s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62" released by "delete_volume" :: held 0.850s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Created reservations ['98d0d8ba-c68b-4f81-bd96-731f15cd3d3f', 'ec73ce6c-6148-4b5c-a1c4-a5e1aac1f814', '73b02cca-8207-449c-ae84-b00466aa8083', '1c022c09-d630-45f6-a4d2-18e96d5d842c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:40 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae" returned: 0 in 0.486s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:40 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 1G Sep 28 21:47:40 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:40 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:40 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-6bdf9561-34ff-49e4-87c3-7c9cb2820472-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-6bdf9561-34ff-49e4-87c3-7c9cb2820472-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-quobyte-6bdf9561-34ff-49e4-87c3-7c9cb2820472" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-6bdf9561-34ff-49e4-87c3-7c9cb2820472" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f428812-5913-4c20-9fdb-fc23c3c62619]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (8a095bab-0528-4c95-abce-ee693db7b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca66355c-999e-49a3-b591-3a8f24ecba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:40 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 Sep 28 21:47:40 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca66355c-999e-49a3-b591-3a8f24ecba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839604048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcfbfad-39c9-4e5b-a521-deca1c54cde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:40Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b091f5ea-17b5-48eb-a79e-9a68dd870c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b091f5ea-17b5-48eb-a79e-9a68dd870c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8904123-3b57-4449-ae7f-0139c1c67808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8904123-3b57-4449-ae7f-0139c1c67808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bcfbfad-39c9-4e5b-a521-deca1c54cde4', 'volume_name': 'volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cfe9fd-d79e-4bf3-af8a-43fb74fdb38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:40 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cfe9fd-d79e-4bf3-af8a-43fb74fdb38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:40 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aecc075-788f-4769-a974-649ecb862253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:40 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume 7bcfbfad-39c9-4e5b-a521-deca1c54cde4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4', 'volume_size': 1} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.553s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 1G" returned: 0 in 0.636s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:40 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Deleted volume successfully. Sep 28 21:47:40 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 Sep 28 21:47:40 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5a471b22-5006-4a3b-ac87-0f672b01688c tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-d0f250b9-0ad0-4c7c-aa08-de2fbf7d9b62-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:40 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472" returned: 0 in 0.460s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:40 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472 Sep 28 21:47:40 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:41 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2" returned: 0 in 0.335s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:41 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 is being set with open permissions: ugo+rw Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:41 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 Sep 28 21:47:41 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:41 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6bdf9561-34ff-49e4-87c3-7c9cb2820472" returned: 0 in 0.275s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-6bdf9561-34ff-49e4-87c3-7c9cb2820472" released by "delete_volume" :: held 0.797s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Created reservations ['1bc213c6-2036-4b4c-9359-b33f2b5e3831', 'f04aa6e6-78e2-47f5-97b8-1b5eb69c64f8', '19626b22-13d3-4795-86f5-711e40b67858', '2df567bd-4c3f-45f7-b198-35f50b109334'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:41 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2" returned: 0 in 0.283s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:41 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:41 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:41 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.info Sep 28 21:47:41 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-a92a2f47-c452-409d-b5a6-ad69f8e1d098-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-a92a2f47-c452-409d-b5a6-ad69f8e1d098-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "cinder-quobyte-a92a2f47-c452-409d-b5a6-ad69f8e1d098" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-a92a2f47-c452-409d-b5a6-ad69f8e1d098" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f46a9-75dd-46f7-ba5c-17a19f840929]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:41 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.377s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:41 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Deleted volume successfully. Sep 28 21:47:41 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.info" returned: 0 in 0.365s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:41 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.info is being set with open permissions: ugo+rw Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3bcec60a-5564-425f-baf6-939d03de22bc tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-6bdf9561-34ff-49e4-87c3-7c9cb2820472-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:41 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.info Sep 28 21:47:41 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:41 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 Sep 28 21:47:41 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:42 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.info" returned: 0 in 0.282s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.369s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839604048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcfbfad-39c9-4e5b-a521-deca1c54cde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:40Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Creating volume 7bcfbfad-39c9-4e5b-a521-deca1c54cde4 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:42 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:42 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 1073741824 Sep 28 21:47:42 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-30995239-c091-4f7f-aa94-d967210e2105 tempest-CinderUnicodeTest-1636315432 None] Create snapshot completed successfully Sep 28 21:47:42 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098" returned: 0 in 0.441s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:42 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098 Sep 28 21:47:42 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:42 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a92a2f47-c452-409d-b5a6-ad69f8e1d098" returned: 0 in 0.278s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-quobyte-a92a2f47-c452-409d-b5a6-ad69f8e1d098" released by "delete_volume" :: held 0.777s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Created reservations ['94d9e11c-89eb-49f4-8626-2ffff2bc49b3', '439b6918-a2c0-4e07-aadb-2daeed560b0d', '3251e714-88ad-4bc4-a3f3-e1a4b66b72b3', '3d223c2e-9345-41e3-895c-3981ce155405'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:42 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 1073741824" returned: 0 in 0.543s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:42 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:42 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:42 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 Sep 28 21:47:42 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "cinder-e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "cinder-quobyte-0c71c37b-bb68-4a95-a24b-80b7f50322ae" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-quobyte-0c71c37b-bb68-4a95-a24b-80b7f50322ae" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "cinder-quobyte-e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-quobyte-e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Deleting offline snapshot e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 of volume 0c71c37b-bb68-4a95-a24b-80b7f50322ae {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] snapshot_file for this snap is: volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:47:43 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.360s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee2a00b-fce9-403b-a2d0-84883a588d62]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:43 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Deleted volume successfully. Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-aee0ee43-b68a-415e-8b01-0ce8931d7b9e tempest-CreateVolumesFromImageTest-1283768098 None] Lock "cinder-a92a2f47-c452-409d-b5a6-ad69f8e1d098-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:43 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" returned: 0 in 0.453s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aecc075-788f-4769-a974-649ecb862253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b6b22c-820b-4c88-b25d-e9d8138065e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:43 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 (7bcfbfad-39c9-4e5b-a521-deca1c54cde4): created successfully Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b6b22c-820b-4c88-b25d-e9d8138065e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:43 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 Sep 28 21:47:43 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (8a095bab-0528-4c95-abce-ee693db7b72f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:43 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bf775339-1897-4214-ade7-aebfaeedf307 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created volume successfully. Sep 28 21:47:43 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2" returned: 0 in 0.494s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66f5212-c5a9-41db-bee3-661c124bf233]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:43 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae Sep 28 21:47:43 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Creating offline snapshot 4783cef1-3b59-4c1f-9488-715d2d45caff of volume 7bcfbfad-39c9-4e5b-a521-deca1c54cde4 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[302522c9-6714-411b-ac10-3f17f5b7108d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:44 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae" returned: 0 in 0.524s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:44 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 Sep 28 21:47:44 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:44 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 Sep 28 21:47:44 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:44 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" returned: 0 in 0.507s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:44 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2" returned: 0 in 0.466s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:44 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff 1G Sep 28 21:47:44 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:44 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2 Sep 28 21:47:44 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:44 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae.e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2" returned: 0 in 0.281s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-quobyte-e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2" released by "_delete_snapshot" :: held 1.958s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-quobyte-0c71c37b-bb68-4a95-a24b-80b7f50322ae" released by "delete_snapshot" :: held 2.000s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:45 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Created reservations ['b5a17175-72ca-4b94-8d89-c981b19373f9', 'd6882482-99de-43b9-a84d-3d14244ba748', 'fdc03a6c-3f06-43e7-b189-44d59c376283', 'c51481a6-131a-49c2-b3d8-828927b1e344'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:45 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:45 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Delete snapshot completed successfully. Sep 28 21:47:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff 1G" returned: 0 in 0.548s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-db5a0fac-eb40-4943-bff6-d8c3dd6b04a0 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-e919ac36-e7a5-4c35-8a8a-c3a459b5c3f2-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:45 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff Sep 28 21:47:45 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:45 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff" returned: 0 in 0.345s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:45 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff is being set with open permissions: ugo+rw Sep 28 21:47:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:45 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff Sep 28 21:47:45 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:45 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:45 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.info Sep 28 21:47:45 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:45 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.info" returned: 0 in 0.273s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:46 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.info is being set with open permissions: ugo+rw Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:46 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.info Sep 28 21:47:46 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "cinder-0c71c37b-bb68-4a95-a24b-80b7f50322ae-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-0c71c37b-bb68-4a95-a24b-80b7f50322ae-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "cinder-quobyte-0c71c37b-bb68-4a95-a24b-80b7f50322ae" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-quobyte-0c71c37b-bb68-4a95-a24b-80b7f50322ae" acquired by "delete_volume" :: waited 0.036s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:46 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.info" returned: 0 in 0.332s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcb6a69-ef9b-44f1-ac09-71443ce85696]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e3785acb-513b-437a-a7c6-dd48e51cd77e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Create snapshot completed successfully Sep 28 21:47:46 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae Sep 28 21:47:46 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:46 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae" returned: 0 in 0.396s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:46 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae Sep 28 21:47:46 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:47 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c71c37b-bb68-4a95-a24b-80b7f50322ae" returned: 0 in 0.302s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-quobyte-0c71c37b-bb68-4a95-a24b-80b7f50322ae" released by "delete_volume" :: held 0.817s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Created reservations ['3bc221ff-66b3-4177-b60d-6b921ae3f23d', 'fb874a7f-e27c-43b4-997e-e6e1ffbbed09', '578da9bc-2e52-478d-874b-017a37c662d8', '51a05f27-0044-435b-88de-8437b9f3645e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:47 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:47 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "cinder-149772e2-a5f2-425d-ac7f-957599b0111b-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-149772e2-a5f2-425d-ac7f-957599b0111b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "cinder-quobyte-149772e2-a5f2-425d-ac7f-957599b0111b" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-quobyte-149772e2-a5f2-425d-ac7f-957599b0111b" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[195afe00-5e47-4e10-9469-0274f6700e94]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:47 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b Sep 28 21:47:47 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:47 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.499s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Deleted volume successfully. Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-83de3cd9-f277-46fe-b4e3-631937a4b8e1 tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-0c71c37b-bb68-4a95-a24b-80b7f50322ae-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:47 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (28bf3f36-6a54-4b04-8aa2-af6b8d7f1319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024217e2-58a0-4f2d-9767-58e9755ef1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024217e2-58a0-4f2d-9767-58e9755ef1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122092454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296481c1-5659-4803-8138-99cb592b3d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:48Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90df0f74-573c-43fe-a285-8457174cb065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90df0f74-573c-43fe-a285-8457174cb065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:48 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c59e80-7d0f-4ddd-b5d4-55446781b3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c59e80-7d0f-4ddd-b5d4-55446781b3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296481c1-5659-4803-8138-99cb592b3d1e', 'volume_name': 'volume-296481c1-5659-4803-8138-99cb592b3d1e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18401093-4a45-4018-8f43-6084a7a23d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18401093-4a45-4018-8f43-6084a7a23d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea9950d-b695-460a-9c2a-31fb498988c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume 296481c1-5659-4803-8138-99cb592b3d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296481c1-5659-4803-8138-99cb592b3d1e', 'volume_size': 1} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122092454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296481c1-5659-4803-8138-99cb592b3d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:48Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Creating volume 296481c1-5659-4803-8138-99cb592b3d1e {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:48 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b" returned: 0 in 0.584s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:48 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e 1073741824 Sep 28 21:47:48 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:48 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b Sep 28 21:47:48 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (8aa6741b-0319-4257-90f1-f499e80615d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f0e945-60b6-4b91-bc26-e82a3541d7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-149772e2-a5f2-425d-ac7f-957599b0111b" returned: 0 in 0.385s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f0e945-60b6-4b91-bc26-e82a3541d7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770671192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30756863-3d7e-48b4-b894-b8f92ee2ada2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:48Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f420b8f4-4f06-49d9-afa8-162b00239fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f420b8f4-4f06-49d9-afa8-162b00239fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0809332e-dc21-4100-b4da-94d921274ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0809332e-dc21-4100-b4da-94d921274ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30756863-3d7e-48b4-b894-b8f92ee2ada2', 'volume_name': 'volume-30756863-3d7e-48b4-b894-b8f92ee2ada2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38902cd-0cee-4df4-9e98-feb270bc1e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38902cd-0cee-4df4-9e98-feb270bc1e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed8f1e8-a3b9-4049-bff9-09db5eeb839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume 30756863-3d7e-48b4-b894-b8f92ee2ada2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30756863-3d7e-48b4-b894-b8f92ee2ada2', 'volume_size': 1} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-quobyte-149772e2-a5f2-425d-ac7f-957599b0111b" released by "delete_volume" :: held 1.109s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Created reservations ['106ae206-0696-4eee-819e-0be121504a4a', 'e413a501-6fa8-4d21-aca7-277b82e618aa', '74785eed-6eb3-4fb0-a0e6-4487404bac14', '4d59e796-c5c9-4daf-ab13-16a17018af21'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:48 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:48 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:48 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e 1073741824" returned: 0 in 0.712s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:48 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e Sep 28 21:47:48 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:48 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (26c9d61f-123a-46ce-a591-7662c0272893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8706219e-6510-43fb-9a12-13fe4398fb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8706219e-6510-43fb-9a12-13fe4398fb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-41811771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b43189-9580-47ec-a49a-78c8107c25cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:49Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef1f4d8-2972-4c63-81b8-8e08548f80de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef1f4d8-2972-4c63-81b8-8e08548f80de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b67e6b-7381-4084-a8b9-9b9026e8e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b67e6b-7381-4084-a8b9-9b9026e8e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b43189-9580-47ec-a49a-78c8107c25cc', 'volume_name': 'volume-70b43189-9580-47ec-a49a-78c8107c25cc', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd8c25f-2dbd-4da4-bbc9-2ea3cff023b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd8c25f-2dbd-4da4-bbc9-2ea3cff023b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6989cb6b-a4a3-4910-babb-22e6c4b28913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume 70b43189-9580-47ec-a49a-78c8107c25cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b43189-9580-47ec-a49a-78c8107c25cc', 'volume_size': 1} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.332s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:49 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Deleted volume successfully. Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-02ab1480-47bc-4a77-9368-0779c09ecadd tempest-CinderUnicodeTest-1636315432 None] Lock "cinder-149772e2-a5f2-425d-ac7f-957599b0111b-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:49 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e" returned: 0 in 0.329s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770671192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30756863-3d7e-48b4-b894-b8f92ee2ada2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:48Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Creating volume 30756863-3d7e-48b4-b894-b8f92ee2ada2 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:49 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea9950d-b695-460a-9c2a-31fb498988c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296481c1-5659-4803-8138-99cb592b3d1e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8811b8b-6e6b-4fa0-b405-84e06db5f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 1073741824 Sep 28 21:47:49 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:49 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume volume-296481c1-5659-4803-8138-99cb592b3d1e (296481c1-5659-4803-8138-99cb592b3d1e): created successfully Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8811b8b-6e6b-4fa0-b405-84e06db5f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (28bf3f36-6a54-4b04-8aa2-af6b8d7f1319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:49 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0b0802a6-0cf9-42dd-813f-29e57985fcec tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created volume successfully. Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (0b2ca26e-3d2b-4585-8593-e00f70f4c32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55b348d-fe07-4abc-98b3-41c9552860a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55b348d-fe07-4abc-98b3-41c9552860a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279932852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c31853-fe77-4c4b-b30b-a8fde3849f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:50Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4147c8d2-3f1d-40ff-8c37-167be0537692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4147c8d2-3f1d-40ff-8c37-167be0537692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cbb5da-0677-4a85-8b04-69caf05499b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cbb5da-0677-4a85-8b04-69caf05499b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c31853-fe77-4c4b-b30b-a8fde3849f72', 'volume_name': 'volume-15c31853-fe77-4c4b-b30b-a8fde3849f72', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a6d5b4-349f-4cd5-b11c-32d6b1367df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a6d5b4-349f-4cd5-b11c-32d6b1367df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27074ba1-0b45-4db2-b7f1-e3d68ebde3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:49 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume 15c31853-fe77-4c4b-b30b-a8fde3849f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c31853-fe77-4c4b-b30b-a8fde3849f72', 'volume_size': 1} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:49 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 1073741824" returned: 0 in 0.632s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:49 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 Sep 28 21:47:49 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:50 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2" returned: 0 in 0.385s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-41811771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b43189-9580-47ec-a49a-78c8107c25cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:49Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Creating volume 70b43189-9580-47ec-a49a-78c8107c25cc {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:50 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed8f1e8-a3b9-4049-bff9-09db5eeb839f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30756863-3d7e-48b4-b894-b8f92ee2ada2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:50 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc 1073741824 Sep 28 21:47:50 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e10f15-6a59-4368-ae20-ceff9113c1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 (30756863-3d7e-48b4-b894-b8f92ee2ada2): created successfully Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e10f15-6a59-4368-ae20-ceff9113c1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (8aa6741b-0319-4257-90f1-f499e80615d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9b7be092-6d4d-4e49-af79-6e594f8a6735 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created volume successfully. Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (e32a5a9d-617b-40b0-bcb6-e041ec0e4590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d83003c-095c-4fe7-aabb-639f0b2fa2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d83003c-095c-4fe7-aabb-639f0b2fa2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1462746397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f31b4bc-81cb-41ff-9336-8d372d7669d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:51Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96074907-90e1-417e-bef3-ce32972b45c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96074907-90e1-417e-bef3-ce32972b45c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293493fb-4eb0-434b-afa4-fdb5827bfb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293493fb-4eb0-434b-afa4-fdb5827bfb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f31b4bc-81cb-41ff-9336-8d372d7669d5', 'volume_name': 'volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f1ad80-71b2-4c8e-a5f9-a7e05828fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f1ad80-71b2-4c8e-a5f9-a7e05828fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3759b3e-36bb-49f5-af99-63036e65977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume 8f31b4bc-81cb-41ff-9336-8d372d7669d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5', 'volume_size': 1} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Flow 'volume_create_manager' (f3066d5e-57e1-4d44-a297-795da2191aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3105279e-ed1c-485d-8194-5ed77294716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3105279e-ed1c-485d-8194-5ed77294716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d9d0c5-4b1d-4f72-a480-3d9489335780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a209a9cd5143afacdf1ae05a4f2bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:51Z,use_quota=True,user_id='0677582852b54ebfa01b7c390c9b05ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04431728-4453-4cd5-a099-c3d818b012b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04431728-4453-4cd5-a099-c3d818b012b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ad941c-aa0f-4a41-b2f0-be70325a3a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:47:50 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc 1073741824" returned: 0 in 0.605s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:50 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc Sep 28 21:47:50 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:51 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc" returned: 0 in 0.311s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279932852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c31853-fe77-4c4b-b30b-a8fde3849f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:50Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Creating volume 15c31853-fe77-4c4b-b30b-a8fde3849f72 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:51 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6989cb6b-a4a3-4910-babb-22e6c4b28913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b43189-9580-47ec-a49a-78c8107c25cc', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bed492-1016-4cfd-ab5f-05891e56ac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:51 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 1073741824 Sep 28 21:47:51 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:51 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume volume-70b43189-9580-47ec-a49a-78c8107c25cc (70b43189-9580-47ec-a49a-78c8107c25cc): created successfully Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bed492-1016-4cfd-ab5f-05891e56ac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (26c9d61f-123a-46ce-a591-7662c0272893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-809c37fd-0edd-4d13-abfb-847c8883aeb6 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created volume successfully. Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ad941c-aa0f-4a41-b2f0-be70325a3a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81d9d0c5-4b1d-4f72-a480-3d9489335780', 'volume_name': 'volume-81d9d0c5-4b1d-4f72-a480-3d9489335780', 'volume_size': 1, 'image_id': 'c764a992-3114-4318-bed1-e8e192730400', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c764a992-3114-4318-bed1-e8e192730400', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ff81fdc1f61877ba9c761aa2deeac18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7a209a9cd5143afacdf1ae05a4f2bb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '731bfb755f446a48f350fb97d52ad002003c111dceba85987a1b08aff1a3fd23f56c8af608cfcd9de9732cd2ff109816d70dcd3d0e9697c592a3d7b3dfc59dfa', 'id': 'c764a992-3114-4318-bed1-e8e192730400', 'created_at': datetime.datetime(2026, 9, 28, 19, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c764a992-3114-4318-bed1-e8e192730400/file', 'properties': {}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46084850-700b-4a7c-995f-b6fa5aeefeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46084850-700b-4a7c-995f-b6fa5aeefeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886f588f-8705-424d-a3ef-931a4a8557dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:51 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Volume 81d9d0c5-4b1d-4f72-a480-3d9489335780: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81d9d0c5-4b1d-4f72-a480-3d9489335780', 'volume_size': 1, 'image_id': 'c764a992-3114-4318-bed1-e8e192730400', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c764a992-3114-4318-bed1-e8e192730400', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ff81fdc1f61877ba9c761aa2deeac18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7a209a9cd5143afacdf1ae05a4f2bb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '731bfb755f446a48f350fb97d52ad002003c111dceba85987a1b08aff1a3fd23f56c8af608cfcd9de9732cd2ff109816d70dcd3d0e9697c592a3d7b3dfc59dfa', 'id': 'c764a992-3114-4318-bed1-e8e192730400', 'created_at': datetime.datetime(2026, 9, 28, 19, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c764a992-3114-4318-bed1-e8e192730400/file', 'properties': {}}, 'image_service': } Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Trying to clone 81d9d0c5-4b1d-4f72-a480-3d9489335780 from image c764a992-3114-4318-bed1-e8e192730400 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c764a992-3114-4318-bed1-e8e192730400', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:47:51 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Image download 0.00 MB at 0.00 MB/s Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7e6289-bbe4-4dac-8c9b-4952dffa7c19]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:51 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD Sep 28 21:47:51 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:51 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 1073741824" returned: 0 in 0.619s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:52 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 Sep 28 21:47:52 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:52 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:52 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:52 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD Sep 28 21:47:52 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72" returned: 0 in 0.403s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1462746397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f31b4bc-81cb-41ff-9336-8d372d7669d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2c27fe5d0fc43278f70cad8492aefec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:51Z,use_quota=True,user_id='67bf0ec7c2de4f5598bad4b70b087286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Creating volume 8f31b4bc-81cb-41ff-9336-8d372d7669d5 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:52 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27074ba1-0b45-4db2-b7f1-e3d68ebde3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c31853-fe77-4c4b-b30b-a8fde3849f72', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24583b8a-1f1c-4556-bc0b-c8052cd0c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:52 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 1073741824 Sep 28 21:47:52 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 (15c31853-fe77-4c4b-b30b-a8fde3849f72): created successfully Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24583b8a-1f1c-4556-bc0b-c8052cd0c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (0b2ca26e-3d2b-4585-8593-e00f70f4c32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-17c6236d-4cf4-42cf-9776-884af0feb1d2 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created volume successfully. Sep 28 21:47:52 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Temporary image c764a992-3114-4318-bed1-e8e192730400 is fetched for user 0677582852b54ebfa01b7c390c9b05ed. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ab318a-099c-4e72-b1ea-28b8cc9e8eb7]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:52 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD Sep 28 21:47:52 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:53 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 1073741824" returned: 0 in 0.612s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:53 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 Sep 28 21:47:53 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:53 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:53 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD Sep 28 21:47:53 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:53 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5" returned: 0 in 0.282s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3759b3e-36bb-49f5-af99-63036e65977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdf7d95-fa2a-44de-a153-1f3521cc7398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:53 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Volume volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 (8f31b4bc-81cb-41ff-9336-8d372d7669d5): created successfully Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdf7d95-fa2a-44de-a153-1f3521cc7398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Flow 'volume_create_manager' (e32a5a9d-617b-40b0-bcb6-e041ec0e4590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:53 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2768bd8a-66b2-4be7-bf2d-a3a0df8ce1f5 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created volume successfully. Sep 28 21:47:53 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d9d0c5-4b1d-4f72-a480-3d9489335780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a209a9cd5143afacdf1ae05a4f2bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:47:51Z,use_quota=True,user_id='0677582852b54ebfa01b7c390c9b05ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Creating volume 81d9d0c5-4b1d-4f72-a480-3d9489335780 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:47:53 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:47:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:53 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 1073741824 Sep 28 21:47:53 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-8f31b4bc-81cb-41ff-9336-8d372d7669d5-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-8f31b4bc-81cb-41ff-9336-8d372d7669d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:54 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 1073741824" returned: 0 in 0.588s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-quobyte-8f31b4bc-81cb-41ff-9336-8d372d7669d5" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-8f31b4bc-81cb-41ff-9336-8d372d7669d5" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dd04f1-d798-49c7-a7bf-c63c89292da5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:54 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 Sep 28 21:47:54 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:54 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 Sep 28 21:47:54 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:54 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780" returned: 0 in 0.345s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Attempting download of c764a992-3114-4318-bed1-e8e192730400 ((None, [{'url': 'file:///opt/stack/data/glance/images/c764a992-3114-4318-bed1-e8e192730400', 'metadata': {}}])) to volume 81d9d0c5-4b1d-4f72-a480-3d9489335780. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc8bd2-7f7f-4480-98af-30d1c0b00663]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c764a992-3114-4318-bed1-e8e192730400_0o2k56vu {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:54 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5" returned: 0 in 0.496s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:54 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5 Sep 28 21:47:54 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:54 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c764a992-3114-4318-bed1-e8e192730400_0o2k56vu Sep 28 21:47:54 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:54 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8f31b4bc-81cb-41ff-9336-8d372d7669d5" returned: 0 in 0.279s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-8f31b4bc-81cb-41ff-9336-8d372d7669d5" released by "delete_volume" :: held 0.847s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created reservations ['de5f6adc-e9d3-4941-bdd9-a15abb5a2464', 'ab38fe61-ef30-4037-8bf0-57ee5dd0d8b2', '75d6b8a1-f809-4a3c-b853-2bebc69335ce', '6ce6263d-0e15-4319-85a1-3c4bcc38762e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:55 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c764a992-3114-4318-bed1-e8e192730400_0o2k56vu" returned: 0 in 0.425s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c764a992-3114-4318-bed1-e8e192730400_0o2k56vu {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:55 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:55 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-15c31853-fe77-4c4b-b30b-a8fde3849f72-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:55 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c764a992-3114-4318-bed1-e8e192730400_0o2k56vu Sep 28 21:47:55 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-15c31853-fe77-4c4b-b30b-a8fde3849f72-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-quobyte-15c31853-fe77-4c4b-b30b-a8fde3849f72" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-15c31853-fe77-4c4b-b30b-a8fde3849f72" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[946a06d2-a96c-405a-9d93-435fca321ccc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:55 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.357s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:55 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Deleted volume successfully. Sep 28 21:47:55 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c764a992-3114-4318-bed1-e8e192730400_0o2k56vu" returned: 1 in 0.473s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c764a992-3114-4318-bed1-e8e192730400_0o2k56vu' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:47:55 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 Sep 28 21:47:55 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-930048f9-c29a-433d-b0b4-32ca2fadeb5a tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-8f31b4bc-81cb-41ff-9336-8d372d7669d5-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35f79d1-90a4-4b3b-b178-11376e0fbd8a]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:55 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD Sep 28 21:47:55 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:55 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72" returned: 0 in 0.471s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:55 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72 Sep 28 21:47:55 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:55 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:56 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD Sep 28 21:47:56 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:56 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15c31853-fe77-4c4b-b30b-a8fde3849f72" returned: 0 in 0.322s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-15c31853-fe77-4c4b-b30b-a8fde3849f72" released by "delete_volume" :: held 0.871s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created reservations ['8e47c3b3-3bd3-465c-95b5-44b5def8bb17', '4a98864e-159d-4506-af4e-79d6854d6547', 'ecce805f-b484-4b1a-b343-cec25af0f12b', 'd1d09b7a-ee6e-4ae2-b359-bd7b775fdb2e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:56 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] c764a992-3114-4318-bed1-e8e192730400 was raw, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:56 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 Sep 28 21:47:56 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:56 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:56 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-70b43189-9580-47ec-a49a-78c8107c25cc-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-70b43189-9580-47ec-a49a-78c8107c25cc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-quobyte-70b43189-9580-47ec-a49a-78c8107c25cc" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-70b43189-9580-47ec-a49a-78c8107c25cc" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd18eba-8d2a-4bec-8238-c4f3ce394f25]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:56 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.351s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Deleted volume successfully. Sep 28 21:47:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cce5879a-a199-456c-b7d6-53cb87fdf06e tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-15c31853-fe77-4c4b-b30b-a8fde3849f72-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:56 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc Sep 28 21:47:56 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:57 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780" returned: 0 in 0.672s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c764a992-3114-4318-bed1-e8e192730400_x13rnz4fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:47:57 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:57 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 1G Sep 28 21:47:57 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc" returned: 0 in 0.470s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:57 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:57 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc Sep 28 21:47:57 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:57 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 1G" returned: 0 in 0.384s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Downloaded image c764a992-3114-4318-bed1-e8e192730400 ((None, [{'url': 'file:///opt/stack/data/glance/images/c764a992-3114-4318-bed1-e8e192730400', 'metadata': {}}])) to volume 81d9d0c5-4b1d-4f72-a480-3d9489335780 successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Temporary image c764a992-3114-4318-bed1-e8e192730400 for user 0677582852b54ebfa01b7c390c9b05ed is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Marking volume 81d9d0c5-4b1d-4f72-a480-3d9489335780 as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Copying metadata from image c764a992-3114-4318-bed1-e8e192730400 to 81d9d0c5-4b1d-4f72-a480-3d9489335780. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Creating volume glance metadata for volume 81d9d0c5-4b1d-4f72-a480-3d9489335780 backed by image c764a992-3114-4318-bed1-e8e192730400 with: {'image_id': 'c764a992-3114-4318-bed1-e8e192730400', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4ff81fdc1f61877ba9c761aa2deeac18', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:47:57 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70b43189-9580-47ec-a49a-78c8107c25cc" returned: 0 in 0.322s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-70b43189-9580-47ec-a49a-78c8107c25cc" released by "delete_volume" :: held 0.862s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886f588f-8705-424d-a3ef-931a4a8557dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d9d0c5-4b1d-4f72-a480-3d9489335780', 'volume_size': 1, 'image_id': 'c764a992-3114-4318-bed1-e8e192730400', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c764a992-3114-4318-bed1-e8e192730400', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ff81fdc1f61877ba9c761aa2deeac18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7a209a9cd5143afacdf1ae05a4f2bb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '731bfb755f446a48f350fb97d52ad002003c111dceba85987a1b08aff1a3fd23f56c8af608cfcd9de9732cd2ff109816d70dcd3d0e9697c592a3d7b3dfc59dfa', 'id': 'c764a992-3114-4318-bed1-e8e192730400', 'created_at': datetime.datetime(2026, 9, 28, 19, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 47, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c764a992-3114-4318-bed1-e8e192730400/file', 'properties': {}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63b3557-d728-4a1c-adf7-7449136caee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:47:57 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Volume volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 (81d9d0c5-4b1d-4f72-a480-3d9489335780): created successfully Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63b3557-d728-4a1c-adf7-7449136caee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Flow 'volume_create_manager' (f3066d5e-57e1-4d44-a297-795da2191aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created reservations ['4db426f5-86fa-426b-b9f8-b0a7715afd33', '42bb8e83-69fb-4a78-ae99-f3119947cbd0', 'af9d64cc-79d3-4c7b-9848-7b9c110d2b0d', '65a061a3-f8e0-4bb8-8576-cf3e278694a3'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:57 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-811590af-3d71-4c20-9ca7-09b49e117674 tempest-VolumeImageDependencyTests-1956375690 None] Created volume successfully. Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:57 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:57 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-30756863-3d7e-48b4-b894-b8f92ee2ada2-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-30756863-3d7e-48b4-b894-b8f92ee2ada2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-quobyte-30756863-3d7e-48b4-b894-b8f92ee2ada2" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-30756863-3d7e-48b4-b894-b8f92ee2ada2" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eaacd3-7c2d-4dd9-aeb5-a607bdebacd1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:58 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.342s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Deleted volume successfully. Sep 28 21:47:58 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 Sep 28 21:47:58 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-84f609ae-0e82-42ca-bbc5-3139003b2cab tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-70b43189-9580-47ec-a49a-78c8107c25cc-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Acquiring lock "cinder-81d9d0c5-4b1d-4f72-a480-3d9489335780-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Lock "cinder-81d9d0c5-4b1d-4f72-a480-3d9489335780-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Acquiring lock "cinder-quobyte-81d9d0c5-4b1d-4f72-a480-3d9489335780" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Lock "cinder-quobyte-81d9d0c5-4b1d-4f72-a480-3d9489335780" acquired by "delete_volume" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:47:58 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2" returned: 0 in 0.554s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a65249-fd82-47ea-9934-fb878d4b31dc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:58 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2 Sep 28 21:47:58 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:58 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 Sep 28 21:47:58 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:58 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-30756863-3d7e-48b4-b894-b8f92ee2ada2" returned: 0 in 0.296s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-30756863-3d7e-48b4-b894-b8f92ee2ada2" released by "delete_volume" :: held 0.907s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created reservations ['c015c105-9697-4d40-beeb-4826557a6ad4', '539dabbd-209c-4946-a450-9ad76d81f580', '02cb9e6b-1646-4fff-8f86-eaac8dda15ce', '924359f9-2995-4ae5-9567-1ee74fbd6c58'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:59 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780" returned: 0 in 0.513s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:59 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:59 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:59 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780 Sep 28 21:47:59 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:59 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-81d9d0c5-4b1d-4f72-a480-3d9489335780" returned: 0 in 0.301s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Lock "cinder-quobyte-81d9d0c5-4b1d-4f72-a480-3d9489335780" released by "delete_volume" :: held 0.886s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:59 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.358s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:59 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Deleted volume successfully. Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4c0e4ecd-f172-4edf-9437-a5a53ebd4f53 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-30756863-3d7e-48b4-b894-b8f92ee2ada2-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Created reservations ['ab7eade0-adf3-434c-908e-1d309593c7a3', '158c9918-c54b-42cf-b046-215ff2a5e777', 'ee13d1a6-8eba-4cb1-b3b4-6a2e4a7dc40b', 'a48546e1-525a-4f49-be7d-1203d434f67e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:47:59 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:47:59 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:47:59 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.253s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:47:59 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Deleted volume successfully. Sep 28 21:47:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-277ac3e0-5110-4857-a263-722872eec4d9 tempest-VolumeImageDependencyTests-1956375690 None] Lock "cinder-81d9d0c5-4b1d-4f72-a480-3d9489335780-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-296481c1-5659-4803-8138-99cb592b3d1e-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-296481c1-5659-4803-8138-99cb592b3d1e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-quobyte-296481c1-5659-4803-8138-99cb592b3d1e" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-296481c1-5659-4803-8138-99cb592b3d1e" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfcafa1-c7a3-421e-aca4-40d97cb15bec]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:00 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e Sep 28 21:48:00 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:00 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e" returned: 0 in 0.434s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:00 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e Sep 28 21:48:00 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:00 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-296481c1-5659-4803-8138-99cb592b3d1e" returned: 0 in 0.322s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-296481c1-5659-4803-8138-99cb592b3d1e" released by "delete_volume" :: held 0.809s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created reservations ['119c2926-790b-40af-b2ec-286a97713457', '70453824-c301-4017-80dc-cfd6624d407b', '4ae29f35-2a48-480a-a5b7-a855a2797727', '4dea6aff-c195-477c-ae75-5808aa55127f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:01 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:01 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-4783cef1-3b59-4c1f-9488-715d2d45caff-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-4783cef1-3b59-4c1f-9488-715d2d45caff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-quobyte-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-quobyte-4783cef1-3b59-4c1f-9488-715d2d45caff" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-4783cef1-3b59-4c1f-9488-715d2d45caff" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Deleting offline snapshot 4783cef1-3b59-4c1f-9488-715d2d45caff of volume 7bcfbfad-39c9-4e5b-a521-deca1c54cde4 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] snapshot_file for this snap is: volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4e63c2-1fbd-4fe0-8362-d8c58f62f20d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:01 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.311s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Deleted volume successfully. Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-80a7483b-87df-4152-aeaa-39964ce20824 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-296481c1-5659-4803-8138-99cb592b3d1e-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:01 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff Sep 28 21:48:01 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:01 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff" returned: 0 in 0.490s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2e2177-7b28-4cef-a76a-31d2019b7af3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:02 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 Sep 28 21:48:02 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:02 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" returned: 0 in 0.584s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:02 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff Sep 28 21:48:02 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:02 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff" returned: 0 in 0.471s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:03 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff Sep 28 21:48:03 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:03 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4.4783cef1-3b59-4c1f-9488-715d2d45caff" returned: 0 in 0.272s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-4783cef1-3b59-4c1f-9488-715d2d45caff" released by "_delete_snapshot" :: held 1.986s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" released by "delete_snapshot" :: held 2.016s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:03 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created reservations ['3ca3129d-eb04-4c3d-9d8b-b056b4e6529c', '7e53b6ed-b3f8-4eb6-bd6b-4953b838ba1e', '9bef66fa-f37c-4f43-999b-d4c29bcf7426', 'af4b6880-0859-497c-9cb8-bedf5ada6100'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:03 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Delete snapshot completed successfully. Sep 28 21:48:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7599915c-f466-4353-b344-c63b1dba48f3 tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-4783cef1-3b59-4c1f-9488-715d2d45caff-delete_snapshot" released by "delete_snapshot" :: held 2.206s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-7bcfbfad-39c9-4e5b-a521-deca1c54cde4-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-7bcfbfad-39c9-4e5b-a521-deca1c54cde4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "cinder-quobyte-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:04 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0056be-f4f7-4da5-b521-85828d64d2b2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:04 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 Sep 28 21:48:04 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:05 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" returned: 0 in 0.548s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:05 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4 Sep 28 21:48:05 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Flow 'volume_create_manager' (28ad0d68-e0ea-4c5d-a315-bd5468eae6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3165178-2aad-486b-8989-739b962cbbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3165178-2aad-486b-8989-739b962cbbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1123561970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a5b995-0e99-4d01-b6e2-328b8f25065b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7caf526f4109472cadb73bc067825886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:05Z,use_quota=True,user_id='fcedd27eca7b41b195df919cd13afb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd606af0-3012-49d7-928f-594456a3f898),volume_type_id=dd606af0-3012-49d7-928f-594456a3f898)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:05 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6d06ae-fa43-4cab-b28b-955d50aa0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6d06ae-fa43-4cab-b28b-955d50aa0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a775dd-ac5b-41b2-852b-251a05964a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a775dd-ac5b-41b2-852b-251a05964a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a5b995-0e99-4d01-b6e2-328b8f25065b', 'volume_name': 'volume-48a5b995-0e99-4d01-b6e2-328b8f25065b', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc80df0d-c9f6-4156-94fb-aba8fceea9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc80df0d-c9f6-4156-94fb-aba8fceea9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1878310a-54c5-4a9f-9f8b-c3b83e600b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:05 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Volume 48a5b995-0e99-4d01-b6e2-328b8f25065b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a5b995-0e99-4d01-b6e2-328b8f25065b', 'volume_size': 1} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1123561970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a5b995-0e99-4d01-b6e2-328b8f25065b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7caf526f4109472cadb73bc067825886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:05Z,use_quota=True,user_id='fcedd27eca7b41b195df919cd13afb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd606af0-3012-49d7-928f-594456a3f898),volume_type_id=dd606af0-3012-49d7-928f-594456a3f898)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Creating volume 48a5b995-0e99-4d01-b6e2-328b8f25065b {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:05 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" returned: 0 in 0.370s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:05 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b 1073741824 Sep 28 21:48:05 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-quobyte-7bcfbfad-39c9-4e5b-a521-deca1c54cde4" released by "delete_volume" :: held 1.023s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Created reservations ['774e869a-7e9f-46e7-b16b-c1ac8995919a', '8deebd7a-5119-4265-b37d-2d469e6d364d', 'cded3dc0-0c44-43a3-a180-4cb6f0367520', '36bccdfb-8ef2-497f-b23f-5136a11bd6e0'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:05 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:05 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:06 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b 1073741824" returned: 0 in 0.483s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:06 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.305s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Deleted volume successfully. Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1e56e9ca-d852-4d76-9b43-741d7521b65d tempest-CreateVolumesFromSnapshotTest-1811617399 None] Lock "cinder-7bcfbfad-39c9-4e5b-a521-deca1c54cde4-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:06 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b Sep 28 21:48:06 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Flow 'volume_create_manager' (d1f092f2-cd64-4767-bf52-914ab06ab0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c3396e-4ff5-43a5-9898-5ea93a2a498a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c3396e-4ff5-43a5-9898-5ea93a2a498a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847788578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bed7403-b3c7-4064-b249-892b010f40fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba4ab1ed7df4d54accb0e6cab7ed563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:06Z,use_quota=True,user_id='b6e5e12d1b8d45329aca8a1a29e47e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99cc176-c83c-4b8c-a68c-54de6672e6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99cc176-c83c-4b8c-a68c-54de6672e6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c66fc6-bb1e-432e-89c1-7e028e8d556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c66fc6-bb1e-432e-89c1-7e028e8d556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bed7403-b3c7-4064-b249-892b010f40fe', 'volume_name': 'volume-1bed7403-b3c7-4064-b249-892b010f40fe', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c597e3a7-faee-4b4b-b7b3-24b947b46191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c597e3a7-faee-4b4b-b7b3-24b947b46191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4742ee43-4cb0-42d1-af5a-f44002d5b807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:06 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Volume 1bed7403-b3c7-4064-b249-892b010f40fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bed7403-b3c7-4064-b249-892b010f40fe', 'volume_size': 1} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:06 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b" returned: 0 in 0.267s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847788578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bed7403-b3c7-4064-b249-892b010f40fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba4ab1ed7df4d54accb0e6cab7ed563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:06Z,use_quota=True,user_id='b6e5e12d1b8d45329aca8a1a29e47e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Creating volume 1bed7403-b3c7-4064-b249-892b010f40fe {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:06 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1878310a-54c5-4a9f-9f8b-c3b83e600b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a5b995-0e99-4d01-b6e2-328b8f25065b', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4d8b7d-402e-421b-89ba-cbc897e94ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:06 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe 1073741824 Sep 28 21:48:06 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:06 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Volume volume-48a5b995-0e99-4d01-b6e2-328b8f25065b (48a5b995-0e99-4d01-b6e2-328b8f25065b): created successfully Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4d8b7d-402e-421b-89ba-cbc897e94ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Flow 'volume_create_manager' (28ad0d68-e0ea-4c5d-a315-bd5468eae6a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-26e784c0-3041-4e9a-b9b2-c7a85e8800d3 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Created volume successfully. Sep 28 21:48:06 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe 1073741824" returned: 0 in 0.451s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:06 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe Sep 28 21:48:06 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:07 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe" returned: 0 in 0.251s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4742ee43-4cb0-42d1-af5a-f44002d5b807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bed7403-b3c7-4064-b249-892b010f40fe', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c48b48a-539f-4d89-9541-88fa398c5716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Volume volume-1bed7403-b3c7-4064-b249-892b010f40fe (1bed7403-b3c7-4064-b249-892b010f40fe): created successfully Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c48b48a-539f-4d89-9541-88fa398c5716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Flow 'volume_create_manager' (d1f092f2-cd64-4767-bf52-914ab06ab0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:07 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-26788e5a-2522-4335-a604-376b9cfe7fa6 tempest-ProjectReaderTests-480548340 None] Created volume successfully. Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:07 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:07 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Acquiring lock "cinder-1bed7403-b3c7-4064-b249-892b010f40fe-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Lock "cinder-1bed7403-b3c7-4064-b249-892b010f40fe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Acquiring lock "cinder-quobyte-1bed7403-b3c7-4064-b249-892b010f40fe" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Lock "cinder-quobyte-1bed7403-b3c7-4064-b249-892b010f40fe" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e5521-c35f-41e2-93c9-8d3926b55769]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:07 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.341s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:48:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:48:07 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe Sep 28 21:48:07 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:08 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:08 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:08 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe" returned: 0 in 0.457s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:08 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe Sep 28 21:48:08 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:08 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.278s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f42d4404-90f9-4960-a78b-b071a0c2490d tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Retype volume completed successfully. Sep 28 21:48:08 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1bed7403-b3c7-4064-b249-892b010f40fe" returned: 0 in 0.284s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Lock "cinder-quobyte-1bed7403-b3c7-4064-b249-892b010f40fe" released by "delete_volume" :: held 0.811s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Created reservations ['e75731cb-cc7c-4341-b01f-fffd44e48bde', '6a3bbce6-339b-4479-b1fd-b3e1170dd0db', '90467689-eac1-48cb-b0c4-7f45b212004f', '208e26fe-3aa4-4bb6-9477-4d7f28693e6d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:08 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:08 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:08 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.272s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Deleted volume successfully. Sep 28 21:48:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b098e24-bee2-4027-91c2-2366c9b536fb tempest-ProjectReaderTests-480548340 None] Lock "cinder-1bed7403-b3c7-4064-b249-892b010f40fe-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Flow 'volume_create_manager' (9c59e9b1-dd94-442c-b0a8-060544eb86a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05b7a6b-d5ba-432e-a6ab-bd6fac0e50c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Acquiring lock "cinder-48a5b995-0e99-4d01-b6e2-328b8f25065b-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05b7a6b-d5ba-432e-a6ab-bd6fac0e50c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-956098384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4cda68-c9d8-4c67-84cc-1572904cd27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba4ab1ed7df4d54accb0e6cab7ed563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:09Z,use_quota=True,user_id='b6e5e12d1b8d45329aca8a1a29e47e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1085e195-b1d7-4b1f-a432-3f6de72ced2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1085e195-b1d7-4b1f-a432-3f6de72ced2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e31393-b679-4bc7-96e9-7ac3310ffc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e31393-b679-4bc7-96e9-7ac3310ffc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4cda68-c9d8-4c67-84cc-1572904cd27c', 'volume_name': 'volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3736922a-f830-4f51-94a9-1135467b0842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3736922a-f830-4f51-94a9-1135467b0842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e859dd8a-b1b7-4da5-81c9-81a2f4edbe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:09 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Volume 0c4cda68-c9d8-4c67-84cc-1572904cd27c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c', 'volume_size': 1} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-956098384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4cda68-c9d8-4c67-84cc-1572904cd27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba4ab1ed7df4d54accb0e6cab7ed563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:09Z,use_quota=True,user_id='b6e5e12d1b8d45329aca8a1a29e47e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Creating volume 0c4cda68-c9d8-4c67-84cc-1572904cd27c {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:09 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "cinder-48a5b995-0e99-4d01-b6e2-328b8f25065b-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:09 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c 1073741824 Sep 28 21:48:09 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Acquiring lock "cinder-quobyte-48a5b995-0e99-4d01-b6e2-328b8f25065b" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "cinder-quobyte-48a5b995-0e99-4d01-b6e2-328b8f25065b" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc490c5e-0bb1-465e-b3c2-32311a61794a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:09 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b Sep 28 21:48:09 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:09 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c 1073741824" returned: 0 in 0.494s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:09 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b" returned: 0 in 0.419s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:09 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c Sep 28 21:48:09 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:09 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b Sep 28 21:48:09 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:10 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c" returned: 0 in 0.278s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:10 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48a5b995-0e99-4d01-b6e2-328b8f25065b" returned: 0 in 0.269s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e859dd8a-b1b7-4da5-81c9-81a2f4edbe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7946b8-246b-4caf-970f-641b07b0aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "cinder-quobyte-48a5b995-0e99-4d01-b6e2-328b8f25065b" released by "delete_volume" :: held 0.758s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:10 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Volume volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c (0c4cda68-c9d8-4c67-84cc-1572904cd27c): created successfully Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7946b8-246b-4caf-970f-641b07b0aa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Flow 'volume_create_manager' (9c59e9b1-dd94-442c-b0a8-060544eb86a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6c8edd51-32f3-4d90-a63c-758ac19e5b74 tempest-ProjectReaderTests-480548340 None] Created volume successfully. Sep 28 21:48:10 devstack cinder-volume[86489]: WARNING cinder.quota [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:48:10 devstack cinder-volume[86489]: WARNING cinder.quota [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Created reservations ['5db193db-bad4-445d-8621-f283b0ae0cec', '49b76d31-b589-4de7-8113-3c4cc5de1005', '100ccfaa-66ec-446b-b144-ca25586539c9', 'f498c22c-6d6b-4950-a28b-4df8b5d10e5c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:10 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:10 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:10 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.278s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Deleted volume successfully. Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=265,cinder:SELECT=187,cinder:DELETE=22,cinder:INSERT=64 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:48:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec2118b-672d-47e3-a41d-55bff14d0592 tempest-VolumeRetypeWithoutMigrationTest-1357704588 None] Lock "cinder-48a5b995-0e99-4d01-b6e2-328b8f25065b-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Acquiring lock "cinder-0c4cda68-c9d8-4c67-84cc-1572904cd27c-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Lock "cinder-0c4cda68-c9d8-4c67-84cc-1572904cd27c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=198,cinder:INSERT=66,cinder:UPDATE=252,cinder:DELETE=18 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Acquiring lock "cinder-quobyte-0c4cda68-c9d8-4c67-84cc-1572904cd27c" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Lock "cinder-quobyte-0c4cda68-c9d8-4c67-84cc-1572904cd27c" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ba2e75-0aa3-4063-9eee-f35a73fab82a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:11 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c Sep 28 21:48:11 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:11 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c" returned: 0 in 0.379s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:11 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c Sep 28 21:48:11 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:12 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0c4cda68-c9d8-4c67-84cc-1572904cd27c" returned: 0 in 0.292s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Lock "cinder-quobyte-0c4cda68-c9d8-4c67-84cc-1572904cd27c" released by "delete_volume" :: held 0.733s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Created reservations ['405b8174-9701-45fd-ba27-29ffc76de76e', 'aa9d9bd9-41b4-491b-a911-7d60b645461f', 'e860303e-8ab3-4f49-aee3-940e77bfe15f', '383a5cab-39f5-4364-9058-68efb09678e3'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:12 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:12 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:12 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.338s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:12 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Deleted volume successfully. Sep 28 21:48:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7b739b3-1591-4906-97c9-0d61e0bb40d3 tempest-ProjectReaderTests-480548340 None] Lock "cinder-0c4cda68-c9d8-4c67-84cc-1572904cd27c-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Flow 'volume_create_manager' (1e6b71db-5aaa-43cf-9324-d36db1621ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c1aee9-11d0-4c87-b6bc-3a305ae89822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c1aee9-11d0-4c87-b6bc-3a305ae89822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180474821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b41633a-7646-4fcf-9b33-ce94952477ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba4ab1ed7df4d54accb0e6cab7ed563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:13Z,use_quota=True,user_id='b6e5e12d1b8d45329aca8a1a29e47e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951d4625-2a37-4d20-a8e3-913fbb798429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951d4625-2a37-4d20-a8e3-913fbb798429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0256a7b-0122-4ae8-8364-e0a76dc2f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0256a7b-0122-4ae8-8364-e0a76dc2f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b41633a-7646-4fcf-9b33-ce94952477ea', 'volume_name': 'volume-4b41633a-7646-4fcf-9b33-ce94952477ea', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3f8829-90db-4200-8e1a-57d06cd84567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3f8829-90db-4200-8e1a-57d06cd84567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18144e4a-ec01-4a8b-81f1-5ea038216692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:13 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Volume 4b41633a-7646-4fcf-9b33-ce94952477ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b41633a-7646-4fcf-9b33-ce94952477ea', 'volume_size': 1} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180474821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b41633a-7646-4fcf-9b33-ce94952477ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba4ab1ed7df4d54accb0e6cab7ed563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:13Z,use_quota=True,user_id='b6e5e12d1b8d45329aca8a1a29e47e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Creating volume 4b41633a-7646-4fcf-9b33-ce94952477ea {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:13 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:13 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea 1073741824 Sep 28 21:48:13 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:13 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea 1073741824" returned: 0 in 0.597s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:13 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea Sep 28 21:48:14 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:14 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea" returned: 0 in 0.268s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:48:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18144e4a-ec01-4a8b-81f1-5ea038216692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b41633a-7646-4fcf-9b33-ce94952477ea', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8adc36-5128-40cc-8970-d138d05f2ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:14 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Volume volume-4b41633a-7646-4fcf-9b33-ce94952477ea (4b41633a-7646-4fcf-9b33-ce94952477ea): created successfully Sep 28 21:48:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8adc36-5128-40cc-8970-d138d05f2ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Flow 'volume_create_manager' (1e6b71db-5aaa-43cf-9324-d36db1621ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:14 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-53797730-10e9-492c-a1bd-9d59f1b103df tempest-ProjectReaderTests-480548340 None] Created volume successfully. Sep 28 21:48:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Acquiring lock "cinder-4b41633a-7646-4fcf-9b33-ce94952477ea-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Lock "cinder-4b41633a-7646-4fcf-9b33-ce94952477ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Acquiring lock "cinder-quobyte-4b41633a-7646-4fcf-9b33-ce94952477ea" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Lock "cinder-quobyte-4b41633a-7646-4fcf-9b33-ce94952477ea" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:15 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4427b6-e338-4b8c-a7af-a6318d3a464b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:15 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea Sep 28 21:48:15 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:15 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea" returned: 0 in 0.362s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:15 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea Sep 28 21:48:15 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:16 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b41633a-7646-4fcf-9b33-ce94952477ea" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Lock "cinder-quobyte-4b41633a-7646-4fcf-9b33-ce94952477ea" released by "delete_volume" :: held 0.658s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Created reservations ['539c1290-1725-4388-ba98-dd4bf577afac', '534c0813-19f1-466f-a266-25c76a110033', '84a0a1ca-796d-4aab-a6a4-9017a2cb8f5b', '0e177b37-64c0-48bc-aa0a-78a8a3b4348f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:16 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:16 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:16 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Deleted volume successfully. Sep 28 21:48:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8274669e-251c-494c-9f08-aec73c6ddbd5 tempest-ProjectReaderTests-480548340 None] Lock "cinder-4b41633a-7646-4fcf-9b33-ce94952477ea-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Flow 'volume_create_manager' (15d95171-8ab1-4d1d-97fa-138b1a81dae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b75135-e39a-4237-80d8-c9c94fa55218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b75135-e39a-4237-80d8-c9c94fa55218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563734903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278574d5-22a1-4e70-967f-96630b02b69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba4ab1ed7df4d54accb0e6cab7ed563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:17Z,use_quota=True,user_id='b6e5e12d1b8d45329aca8a1a29e47e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ed5d65-49f0-4164-9a28-34cff53f9ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ed5d65-49f0-4164-9a28-34cff53f9ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772199e7-7dbb-4891-9ba3-650857eabdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772199e7-7dbb-4891-9ba3-650857eabdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278574d5-22a1-4e70-967f-96630b02b69a', 'volume_name': 'volume-278574d5-22a1-4e70-967f-96630b02b69a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c84ca27-d4d8-485d-9c9a-edcaabb26392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c84ca27-d4d8-485d-9c9a-edcaabb26392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c70fac-62b5-419b-b45b-38e77a48e1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Volume 278574d5-22a1-4e70-967f-96630b02b69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278574d5-22a1-4e70-967f-96630b02b69a', 'volume_size': 1} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563734903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278574d5-22a1-4e70-967f-96630b02b69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba4ab1ed7df4d54accb0e6cab7ed563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:17Z,use_quota=True,user_id='b6e5e12d1b8d45329aca8a1a29e47e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Creating volume 278574d5-22a1-4e70-967f-96630b02b69a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:17 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:17 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a 1073741824 Sep 28 21:48:17 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Flow 'volume_create_manager' (78a2e4ac-f017-4eec-a72f-ed9ccf6259a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d611f723-a93a-4289-a209-46050712de00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d611f723-a93a-4289-a209-46050712de00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-651039456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877ea319-13e7-49a0-872b-0dd8172bc081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ec246d33b74bbb949b78bbb879fff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:17Z,use_quota=True,user_id='3a6af14a641e4327bcc8bb48695d7fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405175c2-0b55-46df-afda-23765597b00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405175c2-0b55-46df-afda-23765597b00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282930b6-b2b4-4eb0-9709-d8a3e3fe1592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282930b6-b2b4-4eb0-9709-d8a3e3fe1592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877ea319-13e7-49a0-872b-0dd8172bc081', 'volume_name': 'volume-877ea319-13e7-49a0-872b-0dd8172bc081', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afd7c45-a41d-4c9f-a096-ada3ddd9a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afd7c45-a41d-4c9f-a096-ada3ddd9a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cc4412-a706-4d2d-be49-b15e6e95707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Volume 877ea319-13e7-49a0-872b-0dd8172bc081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877ea319-13e7-49a0-872b-0dd8172bc081', 'volume_size': 1} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:17 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a 1073741824" returned: 0 in 0.498s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:17 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a Sep 28 21:48:17 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:17 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-651039456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877ea319-13e7-49a0-872b-0dd8172bc081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ec246d33b74bbb949b78bbb879fff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:17Z,use_quota=True,user_id='3a6af14a641e4327bcc8bb48695d7fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Creating volume 877ea319-13e7-49a0-872b-0dd8172bc081 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:17 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:17 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 1073741824 Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c70fac-62b5-419b-b45b-38e77a48e1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278574d5-22a1-4e70-967f-96630b02b69a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdc5d19-7f76-4ef1-ab3e-a05f3c799220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:17 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Volume volume-278574d5-22a1-4e70-967f-96630b02b69a (278574d5-22a1-4e70-967f-96630b02b69a): created successfully Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdc5d19-7f76-4ef1-ab3e-a05f3c799220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Flow 'volume_create_manager' (15d95171-8ab1-4d1d-97fa-138b1a81dae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-392d5821-f56e-42a5-8021-fa021c840582 tempest-ProjectReaderTests-480548340 None] Created volume successfully. Sep 28 21:48:18 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 1073741824" returned: 0 in 0.410s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:18 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 Sep 28 21:48:18 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:18 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cc4412-a706-4d2d-be49-b15e6e95707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877ea319-13e7-49a0-872b-0dd8172bc081', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7029703-ba31-439e-85ef-906354563455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:18 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Volume volume-877ea319-13e7-49a0-872b-0dd8172bc081 (877ea319-13e7-49a0-872b-0dd8172bc081): created successfully Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7029703-ba31-439e-85ef-906354563455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Flow 'volume_create_manager' (78a2e4ac-f017-4eec-a72f-ed9ccf6259a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:18 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-198163a3-058e-4125-93ba-c5334129fc1f tempest-VolumesServicesTestJSON-672358749 None] Created volume successfully. Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Acquiring lock "cinder-278574d5-22a1-4e70-967f-96630b02b69a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Lock "cinder-278574d5-22a1-4e70-967f-96630b02b69a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Acquiring lock "cinder-quobyte-278574d5-22a1-4e70-967f-96630b02b69a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Lock "cinder-quobyte-278574d5-22a1-4e70-967f-96630b02b69a" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d31bba-e745-4851-958c-7eaf294a228f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:19 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a Sep 28 21:48:19 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Acquiring lock "cinder-877ea319-13e7-49a0-872b-0dd8172bc081-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Lock "cinder-877ea319-13e7-49a0-872b-0dd8172bc081-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Acquiring lock "cinder-quobyte-877ea319-13e7-49a0-872b-0dd8172bc081" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Lock "cinder-quobyte-877ea319-13e7-49a0-872b-0dd8172bc081" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0e5a23-a5d2-4e4f-bd1a-657cf4eb408e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:19 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a" returned: 0 in 0.383s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:19 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a Sep 28 21:48:19 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:19 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 Sep 28 21:48:19 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:19 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-278574d5-22a1-4e70-967f-96630b02b69a" returned: 0 in 0.253s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Lock "cinder-quobyte-278574d5-22a1-4e70-967f-96630b02b69a" released by "delete_volume" :: held 0.687s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:19 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081" returned: 0 in 0.369s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Created reservations ['81f277d8-c41b-4016-afa2-73234d819059', 'e4f51152-44e3-4ecf-b911-42c970e8b12b', 'a871a861-ccee-4769-a06b-73f54998789d', '886b6b80-2b01-439d-bcff-46ceb4199c1f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:19 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081 Sep 28 21:48:19 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:20 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:20 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:20 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-877ea319-13e7-49a0-872b-0dd8172bc081" returned: 0 in 0.267s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Lock "cinder-quobyte-877ea319-13e7-49a0-872b-0dd8172bc081" released by "delete_volume" :: held 0.683s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:20 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:20 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Deleted volume successfully. Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Created reservations ['4c6e7570-f7d9-40ae-b2c0-4798e680a440', '282b011c-ae8f-41d0-9214-45d2e85a8958', 'b0e08606-12f7-47aa-a365-1f61c6f45e36', '898a3b40-a173-4834-b49d-8c081c12e629'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ed4f8426-fbed-4f59-ad1d-4529e65d554d tempest-ProjectReaderTests-480548340 None] Lock "cinder-278574d5-22a1-4e70-967f-96630b02b69a-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:20 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:20 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:20 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.270s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:20 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Deleted volume successfully. Sep 28 21:48:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-edded050-a284-4f08-9ee3-56eccdb6fa6a tempest-VolumesServicesTestJSON-672358749 None] Lock "cinder-877ea319-13e7-49a0-872b-0dd8172bc081-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Flow 'volume_create_manager' (aab975e6-3e2c-4818-9eec-d77a69a2333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca738de-b0f7-4eec-b739-c77175f24703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca738de-b0f7-4eec-b739-c77175f24703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1631031788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5d6941-5e7f-4d37-b644-8657532dc1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2871df81b462c8e33d629db13931b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:27Z,use_quota=True,user_id='2f25ac2ddf6c4ca0851a8cc4d626fc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a54e6d6d-4ca7-4d04-812d-085a0b697d5a),volume_type_id=a54e6d6d-4ca7-4d04-812d-085a0b697d5a)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53850978-aebe-4acf-bfb9-f2b7b7a739c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53850978-aebe-4acf-bfb9-f2b7b7a739c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d67360-03bb-4a43-a49c-f1b84f1d81cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d67360-03bb-4a43-a49c-f1b84f1d81cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5d6941-5e7f-4d37-b644-8657532dc1ef', 'volume_name': 'volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb7148e-3407-46f6-81cc-f452b658fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb7148e-3407-46f6-81cc-f452b658fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2766aa74-39d4-4ea7-92e9-0441a1ac7e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Volume 3a5d6941-5e7f-4d37-b644-8657532dc1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef', 'volume_size': 1} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1631031788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5d6941-5e7f-4d37-b644-8657532dc1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2871df81b462c8e33d629db13931b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:27Z,use_quota=True,user_id='2f25ac2ddf6c4ca0851a8cc4d626fc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a54e6d6d-4ca7-4d04-812d-085a0b697d5a),volume_type_id=a54e6d6d-4ca7-4d04-812d-085a0b697d5a)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Creating volume 3a5d6941-5e7f-4d37-b644-8657532dc1ef {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:26 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:48:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:26 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef 1073741824 Sep 28 21:48:26 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:27 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef 1073741824" returned: 0 in 0.428s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:27 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef Sep 28 21:48:27 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:27 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef" returned: 0 in 0.270s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2766aa74-39d4-4ea7-92e9-0441a1ac7e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b2f05b-4e35-44e4-892d-9d2a4a36a0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Volume volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef (3a5d6941-5e7f-4d37-b644-8657532dc1ef): created successfully Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b2f05b-4e35-44e4-892d-9d2a4a36a0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Flow 'volume_create_manager' (aab975e6-3e2c-4818-9eec-d77a69a2333d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-085faf8f-aafe-4b25-a977-1d4ee0402c10 tempest-VolumeTypesAccessTest-446270033 None] Created volume successfully. Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Acquiring lock "cinder-3a5d6941-5e7f-4d37-b644-8657532dc1ef-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Lock "cinder-3a5d6941-5e7f-4d37-b644-8657532dc1ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Acquiring lock "cinder-quobyte-3a5d6941-5e7f-4d37-b644-8657532dc1ef" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Lock "cinder-quobyte-3a5d6941-5e7f-4d37-b644-8657532dc1ef" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c19e77-8296-415e-befb-d87587930f9f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:28 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef Sep 28 21:48:28 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:28 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:28 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef Sep 28 21:48:28 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:28 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3a5d6941-5e7f-4d37-b644-8657532dc1ef" returned: 0 in 0.269s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Lock "cinder-quobyte-3a5d6941-5e7f-4d37-b644-8657532dc1ef" released by "delete_volume" :: held 0.688s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:28 devstack cinder-volume[86489]: WARNING cinder.quota [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1968494838 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1968494838, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:48:28 devstack cinder-volume[86489]: WARNING cinder.quota [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1968494838 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1968494838, it is now deprecated. Please use the default quota class for default quota. Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Created reservations ['05ef39f3-571f-44fc-93b9-496c41058f4f', 'c866fb20-8df1-4dd7-b405-c615313f96fc', 'ff5e74db-964a-4e1e-b7f5-a6b33dbf0139', 'f86b575d-1770-487a-9fcf-b27740af36f6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:28 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:48:28 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:29 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.312s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:29 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:48:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Deleted volume successfully. Sep 28 21:48:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-72d7227a-cfa9-4d3e-a8f5-7b4efc46ad78 tempest-VolumeTypesAccessTest-446270033 None] Lock "cinder-3a5d6941-5e7f-4d37-b644-8657532dc1ef-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:38 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=51,cinder:SELECT=36,cinder:INSERT=9,cinder:DELETE=6 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:48:39 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=29,cinder:INSERT=15,cinder:UPDATE=53,cinder:DELETE=3 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Flow 'volume_create_manager' (a2bc392d-5db3-414e-a3a5-f6a607aacacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e709fe10-7fe9-40b3-86b2-476c13feb01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e709fe10-7fe9-40b3-86b2-476c13feb01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-103689126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bccef4-5dc3-432c-86cb-bef2b341f8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019f7fa73ac944f2bfefeb31dbeb0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:44Z,use_quota=True,user_id='fe9a6154c2a7404481bb484d5551bb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e9da84-99dc-4ecf-975e-9d3844d07bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e9da84-99dc-4ecf-975e-9d3844d07bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b4a99a-a907-47aa-b163-6ad093fd9e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b4a99a-a907-47aa-b163-6ad093fd9e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bccef4-5dc3-432c-86cb-bef2b341f8c5', 'volume_name': 'volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c28b210-6515-4079-b79d-3a1b7751f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c28b210-6515-4079-b79d-3a1b7751f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0effd1af-f205-4060-827d-288939139a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:43 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Volume 21bccef4-5dc3-432c-86cb-bef2b341f8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5', 'volume_size': 1} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-103689126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bccef4-5dc3-432c-86cb-bef2b341f8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019f7fa73ac944f2bfefeb31dbeb0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:44Z,use_quota=True,user_id='fe9a6154c2a7404481bb484d5551bb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Creating volume 21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:43 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:48:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:43 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 1073741824 Sep 28 21:48:43 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:44 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 1073741824" returned: 0 in 0.477s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:44 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 Sep 28 21:48:44 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:44 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0effd1af-f205-4060-827d-288939139a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70ed71b-71cf-479e-958c-6ae77167d58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:44 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Volume volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 (21bccef4-5dc3-432c-86cb-bef2b341f8c5): created successfully Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70ed71b-71cf-479e-958c-6ae77167d58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Flow 'volume_create_manager' (a2bc392d-5db3-414e-a3a5-f6a607aacacb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:44 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c0d58dad-ed10-4ae4-9303-5dd1b4387f2d tempest-SnapshotDependencyTests-204325981 None] Created volume successfully. Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Creating offline snapshot 5a32d6ed-943a-40fe-bac1-d3f79cd75fee of volume 21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:48:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a97e0e8-6a68-4249-bb1a-3202ac276aa9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:45 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 Sep 28 21:48:45 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:45 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5" returned: 0 in 0.380s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:45 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee 1G Sep 28 21:48:45 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:45 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee 1G" returned: 0 in 0.405s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:45 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee Sep 28 21:48:45 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:46 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee" returned: 0 in 0.422s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:46 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee is being set with open permissions: ugo+rw Sep 28 21:48:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:46 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee Sep 28 21:48:46 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:46 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:46 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.info Sep 28 21:48:46 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:46 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.info" returned: 0 in 0.263s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:46 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.info is being set with open permissions: ugo+rw Sep 28 21:48:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:46 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.info Sep 28 21:48:46 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:47 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.info" returned: 0 in 0.290s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-dbde15db-580d-41f4-aeff-d8ab4c259b66 tempest-SnapshotDependencyTests-204325981 None] Create snapshot completed successfully Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Flow 'volume_create_manager' (1e5ddd83-e149-4cb3-8c46-cc8950d5b94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43c2582-6996-4262-8ad6-2cec72ceb8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43c2582-6996-4262-8ad6-2cec72ceb8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcacd45-f7fc-4d73-a76d-d49917a11ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019f7fa73ac944f2bfefeb31dbeb0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a32d6ed-943a-40fe-bac1-d3f79cd75fee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:48:49Z,use_quota=True,user_id='fe9a6154c2a7404481bb484d5551bb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e1d472-574b-4570-923a-ac63b89228a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e1d472-574b-4570-923a-ac63b89228a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f9da0b-1c8f-4f21-8112-71384515f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f9da0b-1c8f-4f21-8112-71384515f863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5bcacd45-f7fc-4d73-a76d-d49917a11ae8', 'volume_name': 'volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8', 'volume_size': 1, 'snapshot_id': '5a32d6ed-943a-40fe-bac1-d3f79cd75fee'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971e806d-275f-4fd3-bae3-197e9dbb6fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971e806d-275f-4fd3-bae3-197e9dbb6fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d00d50-ee34-4745-8d8e-66b2ee2a07be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Volume 5bcacd45-f7fc-4d73-a76d-d49917a11ae8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8', 'volume_size': 1, 'snapshot_id': '5a32d6ed-943a-40fe-bac1-d3f79cd75fee'} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-quobyte-5a32d6ed-943a-40fe-bac1-d3f79cd75fee-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-5a32d6ed-943a-40fe-bac1-d3f79cd75fee-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Creating volume 5bcacd45-f7fc-4d73-a76d-d49917a11ae8 from snapshot 5a32d6ed-943a-40fe-bac1-d3f79cd75fee {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-quobyte-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] snapshot: 5a32d6ed-943a-40fe-bac1-d3f79cd75fee, volume: 5bcacd45-f7fc-4d73-a76d-d49917a11ae8, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb227de-8024-4bd6-a94f-46cb73393b32]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:49 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee Sep 28 21:48:49 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:49 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee" returned: 0 in 0.385s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ca6e7b-e6fb-4ea6-8792-198cae3ea062]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:49 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 Sep 28 21:48:49 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:49 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5" returned: 0 in 0.404s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:48:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:49 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 Sep 28 21:48:49 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:57 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" returned: 0 in 7.501s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:48:57 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Converted 1024.00 MB image at 136.49 MB/s Sep 28 21:48:57 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 is being set with open permissions: ugo+rw Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:57 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 Sep 28 21:48:57 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:57 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" released by "_copy_volume_from_snapshot" :: held 8.674s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-5a32d6ed-943a-40fe-bac1-d3f79cd75fee-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" released by "_create_volume_from_snapshot" :: held 8.735s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.753s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d00d50-ee34-4745-8d8e-66b2ee2a07be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8', 'volume_size': 1, 'snapshot_id': '5a32d6ed-943a-40fe-bac1-d3f79cd75fee'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24453883-6084-4c2e-9f83-ccc3ae5a907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:48:57 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Volume volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 (5bcacd45-f7fc-4d73-a76d-d49917a11ae8): created successfully Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24453883-6084-4c2e-9f83-ccc3ae5a907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:48:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Flow 'volume_create_manager' (1e5ddd83-e149-4cb3-8c46-cc8950d5b94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:48:57 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a9c51151-2177-46e8-a944-98fd1aef8699 tempest-SnapshotDependencyTests-204325981 None] Created volume successfully. Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-5a32d6ed-943a-40fe-bac1-d3f79cd75fee-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-5a32d6ed-943a-40fe-bac1-d3f79cd75fee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-quobyte-21bccef4-5dc3-432c-86cb-bef2b341f8c5" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-21bccef4-5dc3-432c-86cb-bef2b341f8c5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-quobyte-5a32d6ed-943a-40fe-bac1-d3f79cd75fee" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-5a32d6ed-943a-40fe-bac1-d3f79cd75fee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Deleting offline snapshot 5a32d6ed-943a-40fe-bac1-d3f79cd75fee of volume 21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] snapshot_file for this snap is: volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2def16-80f5-4ee8-b7e6-3471b3dbb010]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:58 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee Sep 28 21:48:58 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:59 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee" returned: 0 in 0.376s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:48:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad5812-5e18-4a64-b71b-953c723aad69]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:48:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:59 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 Sep 28 21:48:59 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:48:59 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 28 21:48:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5" returned: 0 in 0.569s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:48:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:48:59 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee Sep 28 21:48:59 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:00 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee" returned: 0 in 0.379s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:00 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee Sep 28 21:49:00 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:00 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5.5a32d6ed-943a-40fe-bac1-d3f79cd75fee" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-5a32d6ed-943a-40fe-bac1-d3f79cd75fee" released by "_delete_snapshot" :: held 1.711s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-21bccef4-5dc3-432c-86cb-bef2b341f8c5" released by "delete_snapshot" :: held 1.734s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Created reservations ['f2daa045-384b-45fd-8ed1-43f9db608e03', '39e49fe8-df5e-466f-a412-46f33634d19a', '85129692-49ec-4c51-93a9-4ab1d7d53477', '51585530-c061-4d99-b772-348caad59de7'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Delete snapshot completed successfully. Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-30f37275-4e36-4dc5-9e52-711356bf4c6c tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-5a32d6ed-943a-40fe-bac1-d3f79cd75fee-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-21bccef4-5dc3-432c-86cb-bef2b341f8c5-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-21bccef4-5dc3-432c-86cb-bef2b341f8c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-quobyte-21bccef4-5dc3-432c-86cb-bef2b341f8c5" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-21bccef4-5dc3-432c-86cb-bef2b341f8c5" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b2047-ffcc-4eb4-8b6d-6f2a8ed90755]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:01 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 Sep 28 21:49:01 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:01 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5" returned: 0 in 0.379s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:01 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5 Sep 28 21:49:01 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:01 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-21bccef4-5dc3-432c-86cb-bef2b341f8c5" returned: 0 in 0.262s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-21bccef4-5dc3-432c-86cb-bef2b341f8c5" released by "delete_volume" :: held 0.723s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Created reservations ['b17f5f64-c104-4bd3-8de2-3347faaaa8e0', '326fb3e0-d355-4488-a2fd-6c7411bf8c6d', '9a0aaa80-cefa-4a1c-a7ae-a8a8846245c1', '7bf842b2-e4b0-4e5d-b9e9-11d18f5d7699'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:01 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:01 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:01 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-5bcacd45-f7fc-4d73-a76d-d49917a11ae8-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.267s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Deleted volume successfully. Sep 28 21:49:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-5bcacd45-f7fc-4d73-a76d-d49917a11ae8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-23112540-bdb9-40c1-9832-52ffc05f09c0 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-21bccef4-5dc3-432c-86cb-bef2b341f8c5-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "cinder-quobyte-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66f6d35-d0fb-47de-b5cd-16fdf622d905]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:02 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 Sep 28 21:49:02 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:02 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" returned: 0 in 0.405s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:02 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8 Sep 28 21:49:02 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:02 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" returned: 0 in 0.253s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-quobyte-5bcacd45-f7fc-4d73-a76d-d49917a11ae8" released by "delete_volume" :: held 0.711s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Created reservations ['ea907a11-8852-4fc7-9032-b98a35785dec', '7e74d875-80b0-4d26-9eb7-18f95be8e0b8', '13d6434a-0f5a-4cbd-9c16-2bf860e5fa4a', '94e65b03-eb10-4c46-8bb2-6504b7c68b9d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:02 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:02 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:03 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.265s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:03 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:03 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Deleted volume successfully. Sep 28 21:49:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b14c32b-bc00-4dfd-b185-6fe930c1c030 tempest-SnapshotDependencyTests-204325981 None] Lock "cinder-5bcacd45-f7fc-4d73-a76d-d49917a11ae8-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:07 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:07 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:07 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.398s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:49:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (38dd7a70-651d-42fc-8526-2ffa2fc221d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71984d70-6566-42c5-89e4-70ca03b007e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71984d70-6566-42c5-89e4-70ca03b007e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-532915479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf52be08-05dd-450a-87ea-75fcf40c097e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:14Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d346a20c-bb0b-4136-a794-854acaeeed6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d346a20c-bb0b-4136-a794-854acaeeed6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a05ae9-e765-4686-a8fb-aee976877c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a05ae9-e765-4686-a8fb-aee976877c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf52be08-05dd-450a-87ea-75fcf40c097e', 'volume_name': 'volume-cf52be08-05dd-450a-87ea-75fcf40c097e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8756a4-a297-4530-b3e3-d4169fd51e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8756a4-a297-4530-b3e3-d4169fd51e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c806672-4c03-4642-b581-02c13b832895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:14 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Volume cf52be08-05dd-450a-87ea-75fcf40c097e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf52be08-05dd-450a-87ea-75fcf40c097e', 'volume_size': 1} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-532915479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf52be08-05dd-450a-87ea-75fcf40c097e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:14Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Creating volume cf52be08-05dd-450a-87ea-75fcf40c097e {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:14 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:14 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e 1073741824 Sep 28 21:49:14 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:15 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e 1073741824" returned: 0 in 0.503s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:15 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e Sep 28 21:49:15 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:15 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e" returned: 0 in 0.285s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c806672-4c03-4642-b581-02c13b832895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf52be08-05dd-450a-87ea-75fcf40c097e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d55f99-4763-43ac-974c-d7b7befeed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:15 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Volume volume-cf52be08-05dd-450a-87ea-75fcf40c097e (cf52be08-05dd-450a-87ea-75fcf40c097e): created successfully Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d55f99-4763-43ac-974c-d7b7befeed5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (38dd7a70-651d-42fc-8526-2ffa2fc221d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1d04895f-d7ac-4814-a6ec-e7fac3612136 tempest-VolumesActionsTest-1329468978 None] Created volume successfully. Sep 28 21:49:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ddb0eeb4-09fa-4a2b-9033-8f88429856b3 tempest-VolumesActionsTest-1329468978 None] Acquiring lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e" by "attach_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ddb0eeb4-09fa-4a2b-9033-8f88429856b3 tempest-VolumesActionsTest-1329468978 None] Lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e" acquired by "attach_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ddb0eeb4-09fa-4a2b-9033-8f88429856b3 tempest-VolumesActionsTest-1329468978 None] Attaching volume cf52be08-05dd-450a-87ea-75fcf40c097e to instance c651cb7b-25e2-4c87-8904-ca3b81a489df at mountpoint /dev/vdb on host None. Sep 28 21:49:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ddb0eeb4-09fa-4a2b-9033-8f88429856b3 tempest-VolumesActionsTest-1329468978 None] Attach volume completed successfully. Sep 28 21:49:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ddb0eeb4-09fa-4a2b-9033-8f88429856b3 tempest-VolumesActionsTest-1329468978 None] Lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e" released by "attach_volume" :: held 0.101s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d868b4ec-0d78-4176-a7fa-4269fa05232c tempest-VolumesActionsTest-1470222469 None] Terminate volume connection completed successfully. Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d868b4ec-0d78-4176-a7fa-4269fa05232c tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-detach_volume" by "detach_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d868b4ec-0d78-4176-a7fa-4269fa05232c tempest-VolumesActionsTest-1470222469 None] Lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d868b4ec-0d78-4176-a7fa-4269fa05232c tempest-VolumesActionsTest-1470222469 None] Detaching volume cf52be08-05dd-450a-87ea-75fcf40c097e from instance c651cb7b-25e2-4c87-8904-ca3b81a489df. Sep 28 21:49:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d868b4ec-0d78-4176-a7fa-4269fa05232c tempest-VolumesActionsTest-1470222469 None] Detach volume completed successfully. Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d868b4ec-0d78-4176-a7fa-4269fa05232c tempest-VolumesActionsTest-1470222469 None] Lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cea41ecf-80ee-48b1-9bec-3b1d1dd082fe tempest-VolumesActionsTest-1329468978 None] Acquiring lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-detach_volume" by "detach_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cea41ecf-80ee-48b1-9bec-3b1d1dd082fe tempest-VolumesActionsTest-1329468978 None] Lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-cea41ecf-80ee-48b1-9bec-3b1d1dd082fe tempest-VolumesActionsTest-1329468978 None] Volume detach called, but volume not attached. Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cea41ecf-80ee-48b1-9bec-3b1d1dd082fe tempest-VolumesActionsTest-1329468978 None] Lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Acquiring lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Acquiring lock "cinder-quobyte-cf52be08-05dd-450a-87ea-75fcf40c097e" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Lock "cinder-quobyte-cf52be08-05dd-450a-87ea-75fcf40c097e" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[008ed32d-2b95-446a-8965-38dcb1507eeb]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:18 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e Sep 28 21:49:18 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:18 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e" returned: 0 in 0.370s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:18 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e Sep 28 21:49:18 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:18 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cf52be08-05dd-450a-87ea-75fcf40c097e" returned: 0 in 0.279s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Lock "cinder-quobyte-cf52be08-05dd-450a-87ea-75fcf40c097e" released by "delete_volume" :: held 0.712s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Created reservations ['1590f010-349a-47c0-b785-ccfe9896d125', '3723029b-f0c0-4a9d-9e3c-8129ae928b61', '45d3ae0f-57fc-4d82-aa3d-20ed13801deb', 'c8531a40-b1ae-486c-82d8-adc652ea3f24'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:18 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:18 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:19 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.286s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:19 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Deleted volume successfully. Sep 28 21:49:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d3d09c5-4323-4c16-b95e-8b393895722d tempest-VolumesActionsTest-1329468978 None] Lock "cinder-cf52be08-05dd-450a-87ea-75fcf40c097e-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (42117186-19d8-4919-aee9-c021004bc256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002e440b-be3d-478a-855f-f82043fd5eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002e440b-be3d-478a-855f-f82043fd5eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847873570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a12f928-5682-4b99-9836-7ef7adc05869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:22Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bb2814-af15-4db6-9816-58ddb97dbfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bb2814-af15-4db6-9816-58ddb97dbfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f636fe5d-0350-4c6e-b13a-e0d7d0ca25b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f636fe5d-0350-4c6e-b13a-e0d7d0ca25b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a12f928-5682-4b99-9836-7ef7adc05869', 'volume_name': 'volume-0a12f928-5682-4b99-9836-7ef7adc05869', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b9c877-8844-4b3e-831c-c089c17ed288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b9c877-8844-4b3e-831c-c089c17ed288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef76626-2d34-4af4-835c-869d69a38323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Volume 0a12f928-5682-4b99-9836-7ef7adc05869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a12f928-5682-4b99-9836-7ef7adc05869', 'volume_size': 1} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847873570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a12f928-5682-4b99-9836-7ef7adc05869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:22Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Creating volume 0a12f928-5682-4b99-9836-7ef7adc05869 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:22 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:22 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 1073741824 Sep 28 21:49:22 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:22 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 1073741824" returned: 0 in 0.427s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:22 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 Sep 28 21:49:22 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:22 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869" returned: 0 in 0.246s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef76626-2d34-4af4-835c-869d69a38323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a12f928-5682-4b99-9836-7ef7adc05869', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda5c42e-cc48-4957-9048-8fa87e003f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Volume volume-0a12f928-5682-4b99-9836-7ef7adc05869 (0a12f928-5682-4b99-9836-7ef7adc05869): created successfully Sep 28 21:49:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda5c42e-cc48-4957-9048-8fa87e003f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (42117186-19d8-4919-aee9-c021004bc256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2dbf1e84-6ecf-4fd6-b68d-a916f5cba3ae tempest-VolumesActionsTest-1329468978 None] Created volume successfully. Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-0a12f928-5682-4b99-9836-7ef7adc05869-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Lock "cinder-0a12f928-5682-4b99-9836-7ef7adc05869-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-quobyte-0a12f928-5682-4b99-9836-7ef7adc05869" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Lock "cinder-quobyte-0a12f928-5682-4b99-9836-7ef7adc05869" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e71db59-67ec-4c51-bc90-a3ffa1526376]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:23 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 Sep 28 21:49:23 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:23 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869" returned: 0 in 0.353s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:23 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869 Sep 28 21:49:23 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:23 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0a12f928-5682-4b99-9836-7ef7adc05869" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Lock "cinder-quobyte-0a12f928-5682-4b99-9836-7ef7adc05869" released by "delete_volume" :: held 0.634s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Created reservations ['2995a586-be36-496e-9021-0784896d8450', 'd7a8cd9c-9f52-40d4-a475-9edd72b785b6', '3526c60b-1b81-4562-a875-14ff4d9c1fee', 'ebf6b0b6-5bc8-4983-884f-f7090d4311a9'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:24 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:24 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:24 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:24 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Deleted volume successfully. Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2dbceb04-5357-4e61-8185-ad7820fb83ae tempest-VolumesActionsTest-1470222469 None] Lock "cinder-0a12f928-5682-4b99-9836-7ef7adc05869-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (4e8c2386-a8f4-4ffb-bbea-687218a97e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599890d1-dc8f-4778-9f5a-7cbb197eb2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599890d1-dc8f-4778-9f5a-7cbb197eb2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-681493921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08105f0-0f4d-43f2-a303-b182c3cf24c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:25Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe86098-a767-4d6d-bdfd-011be4b39861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe86098-a767-4d6d-bdfd-011be4b39861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80dd2ca-7745-4e40-a0d5-545c8c1fa673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80dd2ca-7745-4e40-a0d5-545c8c1fa673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08105f0-0f4d-43f2-a303-b182c3cf24c4', 'volume_name': 'volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de91726b-4fee-4c70-8134-fbc39c9476a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de91726b-4fee-4c70-8134-fbc39c9476a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233099d7-1461-4585-a967-86bf09532fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:24 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Volume b08105f0-0f4d-43f2-a303-b182c3cf24c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4', 'volume_size': 1} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-681493921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08105f0-0f4d-43f2-a303-b182c3cf24c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:25Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Creating volume b08105f0-0f4d-43f2-a303-b182c3cf24c4 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:25 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:25 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 1073741824 Sep 28 21:49:25 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:25 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 1073741824" returned: 0 in 0.409s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:25 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 Sep 28 21:49:25 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:25 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233099d7-1461-4585-a967-86bf09532fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ce7840-d59f-4fd7-9edf-7664fc34c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Volume volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 (b08105f0-0f4d-43f2-a303-b182c3cf24c4): created successfully Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ce7840-d59f-4fd7-9edf-7664fc34c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (4e8c2386-a8f4-4ffb-bbea-687218a97e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:25 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6a9ae964-6ed1-45bf-8b2d-3a2ed46663ac tempest-VolumesActionsTest-1329468978 None] Created volume successfully. Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-b08105f0-0f4d-43f2-a303-b182c3cf24c4-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Lock "cinder-b08105f0-0f4d-43f2-a303-b182c3cf24c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-quobyte-b08105f0-0f4d-43f2-a303-b182c3cf24c4" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Lock "cinder-quobyte-b08105f0-0f4d-43f2-a303-b182c3cf24c4" acquired by "delete_volume" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[42553af7-39ef-4c9e-9db8-3e61b3f3fb64]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:26 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 Sep 28 21:49:26 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:26 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4" returned: 0 in 0.355s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:26 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4 Sep 28 21:49:26 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:26 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b08105f0-0f4d-43f2-a303-b182c3cf24c4" returned: 0 in 0.246s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Lock "cinder-quobyte-b08105f0-0f4d-43f2-a303-b182c3cf24c4" released by "delete_volume" :: held 0.639s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Created reservations ['d0bb6d2a-1cc9-458b-876f-4645d6f007b9', '43ded64d-aba2-485d-92fe-b7d181d50303', '5de664cd-da8b-49eb-a953-0dd99636e4fe', 'ef7882bc-fb84-4ba2-b7eb-aa261a974b54'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:26 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:26 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:27 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Deleted volume successfully. Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b09d9d38-54e3-494b-bcfe-e83ac4e6206f tempest-VolumesActionsTest-1470222469 None] Lock "cinder-b08105f0-0f4d-43f2-a303-b182c3cf24c4-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (f4fe9289-45c4-4034-8815-edb37144e6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57aa033-1569-4e98-9c49-312a099a83d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57aa033-1569-4e98-9c49-312a099a83d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2135168649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8532aea8-285f-4db4-8351-258184c89250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:28Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb2a92b-ffad-4981-afd2-124822345935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb2a92b-ffad-4981-afd2-124822345935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e5a0c5-73a8-4173-8083-fddfd49f77f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e5a0c5-73a8-4173-8083-fddfd49f77f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8532aea8-285f-4db4-8351-258184c89250', 'volume_name': 'volume-8532aea8-285f-4db4-8351-258184c89250', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d74e34-ac9c-4578-b7ab-e194b7ff21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d74e34-ac9c-4578-b7ab-e194b7ff21c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3f35e6-1902-4ad3-8376-5abe816cf954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Volume 8532aea8-285f-4db4-8351-258184c89250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8532aea8-285f-4db4-8351-258184c89250', 'volume_size': 1} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2135168649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8532aea8-285f-4db4-8351-258184c89250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:28Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Creating volume 8532aea8-285f-4db4-8351-258184c89250 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:27 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:27 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 1073741824 Sep 28 21:49:27 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:28 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 1073741824" returned: 0 in 0.405s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:28 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 Sep 28 21:49:28 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:28 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250" returned: 0 in 0.247s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3f35e6-1902-4ad3-8376-5abe816cf954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8532aea8-285f-4db4-8351-258184c89250', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567f9c69-52c5-4a14-b7f7-5646a6550cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:28 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Volume volume-8532aea8-285f-4db4-8351-258184c89250 (8532aea8-285f-4db4-8351-258184c89250): created successfully Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567f9c69-52c5-4a14-b7f7-5646a6550cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (f4fe9289-45c4-4034-8815-edb37144e6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7b0d8a30-18dc-4126-af39-cdf1ccb76a89 tempest-VolumesActionsTest-1329468978 None] Created volume successfully. Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-8532aea8-285f-4db4-8351-258184c89250-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Lock "cinder-8532aea8-285f-4db4-8351-258184c89250-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-quobyte-8532aea8-285f-4db4-8351-258184c89250" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Lock "cinder-quobyte-8532aea8-285f-4db4-8351-258184c89250" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4d32a9-c679-4a8b-b2ae-96f2ff9ad72a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:28 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 Sep 28 21:49:28 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:29 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250" returned: 0 in 0.358s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:29 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250 Sep 28 21:49:29 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:29 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8532aea8-285f-4db4-8351-258184c89250" returned: 0 in 0.240s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Lock "cinder-quobyte-8532aea8-285f-4db4-8351-258184c89250" released by "delete_volume" :: held 0.639s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Created reservations ['a15ad2b6-dc50-4a1d-9928-67f1446b2352', '1825a68e-5430-42dd-82d1-7f0a62360c58', '9df47c51-4532-4ee4-b0f5-35a771f7c92c', '2b03eb7c-8275-4e42-be92-7969bb47e0f3'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:29 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:29 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:29 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Deleted volume successfully. Sep 28 21:49:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2290db72-c9ff-4372-b83d-9d588866263e tempest-VolumesActionsTest-1470222469 None] Lock "cinder-8532aea8-285f-4db4-8351-258184c89250-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (cd495e3f-08b8-4d14-b040-a922a1bef1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15e1ada-aeda-4efa-a7e8-059160e41e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15e1ada-aeda-4efa-a7e8-059160e41e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1478577603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172b44ca-63da-4e8f-baa0-aa08339c6f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:30Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ca28a0-6e02-401c-b758-2b67d30911c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ca28a0-6e02-401c-b758-2b67d30911c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5fb001-242d-40e8-9d29-0fba5893273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5fb001-242d-40e8-9d29-0fba5893273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172b44ca-63da-4e8f-baa0-aa08339c6f1d', 'volume_name': 'volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a7774c-93ec-400f-ac59-c27fa012908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a7774c-93ec-400f-ac59-c27fa012908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a0ecd4-3ba1-447a-9719-1231fd0d447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Volume 172b44ca-63da-4e8f-baa0-aa08339c6f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d', 'volume_size': 1} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1478577603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172b44ca-63da-4e8f-baa0-aa08339c6f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:30Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Creating volume 172b44ca-63da-4e8f-baa0-aa08339c6f1d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:30 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:30 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d 1073741824 Sep 28 21:49:30 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:30 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d 1073741824" returned: 0 in 0.423s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:30 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d Sep 28 21:49:30 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:31 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d" returned: 0 in 0.247s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a0ecd4-3ba1-447a-9719-1231fd0d447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ab9dc0-2f01-40c9-8099-2c5635ff417f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Volume volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d (172b44ca-63da-4e8f-baa0-aa08339c6f1d): created successfully Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ab9dc0-2f01-40c9-8099-2c5635ff417f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (cd495e3f-08b8-4d14-b040-a922a1bef1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fec4634a-39f3-4db1-a648-e792e6fececf tempest-VolumesActionsTest-1329468978 None] Created volume successfully. Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-172b44ca-63da-4e8f-baa0-aa08339c6f1d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Lock "cinder-172b44ca-63da-4e8f-baa0-aa08339c6f1d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Acquiring lock "cinder-quobyte-172b44ca-63da-4e8f-baa0-aa08339c6f1d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Lock "cinder-quobyte-172b44ca-63da-4e8f-baa0-aa08339c6f1d" acquired by "delete_volume" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e120b19-813c-4601-a694-3a9811f3cba4]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:31 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d Sep 28 21:49:31 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:31 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d" returned: 0 in 0.354s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:32 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d Sep 28 21:49:32 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:32 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-172b44ca-63da-4e8f-baa0-aa08339c6f1d" returned: 0 in 0.254s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Lock "cinder-quobyte-172b44ca-63da-4e8f-baa0-aa08339c6f1d" released by "delete_volume" :: held 0.649s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Created reservations ['a0bb0638-4805-4142-b8c3-e9b4a820ac31', '3001a199-ef05-4593-8438-605d512ab858', '85f96cd1-d674-4642-8c49-ec3317babd2b', 'ccf0d87a-1bb6-4903-9ac9-2caf8190b735'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:32 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:32 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:32 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.235s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Deleted volume successfully. Sep 28 21:49:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d39e1951-972d-4df2-a9de-ce626bdd81bd tempest-VolumesActionsTest-1470222469 None] Lock "cinder-172b44ca-63da-4e8f-baa0-aa08339c6f1d-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (5c7f5b20-a832-475c-8ff5-8556f05f5e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295433d4-6dd0-40ee-ace7-9c555db11601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295433d4-6dd0-40ee-ace7-9c555db11601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833119004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363f2147-1aad-428a-b6c6-0df1afb3d0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:33Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53c92e0-7968-4c15-8c86-8ca7e9c9b80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53c92e0-7968-4c15-8c86-8ca7e9c9b80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f1148f-a79f-4da7-bd77-cd448b8c073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f1148f-a79f-4da7-bd77-cd448b8c073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '363f2147-1aad-428a-b6c6-0df1afb3d0b8', 'volume_name': 'volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede97508-8f79-468b-b3ac-7a786fba920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede97508-8f79-468b-b3ac-7a786fba920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abac38d9-efef-4d6f-b326-09fc620ab19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Volume 363f2147-1aad-428a-b6c6-0df1afb3d0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8', 'volume_size': 1} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833119004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363f2147-1aad-428a-b6c6-0df1afb3d0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6ecdd1ab3b438d93fde9874c2141ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:33Z,use_quota=True,user_id='b22492446f7a4e07b5e78fd034577f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Creating volume 363f2147-1aad-428a-b6c6-0df1afb3d0b8 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:33 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:33 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 1073741824 Sep 28 21:49:33 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:33 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 1073741824" returned: 0 in 0.407s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:33 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 Sep 28 21:49:33 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:33 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8" returned: 0 in 0.236s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abac38d9-efef-4d6f-b326-09fc620ab19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f95e763-8835-45e4-a703-eeda5036e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Volume volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 (363f2147-1aad-428a-b6c6-0df1afb3d0b8): created successfully Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f95e763-8835-45e4-a703-eeda5036e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Flow 'volume_create_manager' (5c7f5b20-a832-475c-8ff5-8556f05f5e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:33 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1deb9e30-af84-4f13-b97b-de384859988d tempest-VolumesActionsTest-1329468978 None] Created volume successfully. Sep 28 21:49:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Acquiring lock "cinder-363f2147-1aad-428a-b6c6-0df1afb3d0b8-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Lock "cinder-363f2147-1aad-428a-b6c6-0df1afb3d0b8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Acquiring lock "cinder-quobyte-363f2147-1aad-428a-b6c6-0df1afb3d0b8" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Lock "cinder-quobyte-363f2147-1aad-428a-b6c6-0df1afb3d0b8" acquired by "delete_volume" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c497eb1-6b95-41af-9c98-0260be9df182]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:34 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 Sep 28 21:49:34 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:35 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:35 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8 Sep 28 21:49:35 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:35 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-363f2147-1aad-428a-b6c6-0df1afb3d0b8" returned: 0 in 0.237s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Lock "cinder-quobyte-363f2147-1aad-428a-b6c6-0df1afb3d0b8" released by "delete_volume" :: held 0.628s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Created reservations ['59865133-2171-4dfc-a44b-ba7bb7e5d4de', '8ad5eabf-4a1e-4387-9ccf-ce6b87856189', '1d579105-09b8-4fc6-b7e3-03ebbf8f4990', '87c0411c-e91a-4768-a5b6-65a24b99361e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:35 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:35 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:35 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.243s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Deleted volume successfully. Sep 28 21:49:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-207a922e-ad84-4e44-b8c9-b6a712df4dc7 tempest-VolumesActionsTest-1329468978 None] Lock "cinder-363f2147-1aad-428a-b6c6-0df1afb3d0b8-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:45 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=68,cinder:UPDATE=105,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:49:45 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=81,cinder:UPDATE=93,cinder:INSERT=25,cinder:DELETE=12 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Flow 'volume_create_manager' (1e4b4aa3-c547-4563-8d59-cf0de5a45919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dbd7d8-28dc-4532-9987-bf80e2f2a607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dbd7d8-28dc-4532-9987-bf80e2f2a607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-252171813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9547db12-e700-4724-9bd0-9e91a332fd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e9cb6dc5f4654b86d0c5cf6ac7f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:48Z,use_quota=True,user_id='d74935a9166e4ecd8ee47333d35341ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c14165-a15d-4cc2-b9ac-bb506534a1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c14165-a15d-4cc2-b9ac-bb506534a1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5b9510-3460-46c2-9422-e241ba188d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5b9510-3460-46c2-9422-e241ba188d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9547db12-e700-4724-9bd0-9e91a332fd77', 'volume_name': 'volume-9547db12-e700-4724-9bd0-9e91a332fd77', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca18a73c-30e2-44b7-9a46-8f8050b19fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca18a73c-30e2-44b7-9a46-8f8050b19fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1341b6a-55d7-443d-9164-b226da8d6fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:47 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Volume 9547db12-e700-4724-9bd0-9e91a332fd77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9547db12-e700-4724-9bd0-9e91a332fd77', 'volume_size': 1} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-252171813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9547db12-e700-4724-9bd0-9e91a332fd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e9cb6dc5f4654b86d0c5cf6ac7f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:48Z,use_quota=True,user_id='d74935a9166e4ecd8ee47333d35341ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Creating volume 9547db12-e700-4724-9bd0-9e91a332fd77 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:47 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:47 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 1073741824 Sep 28 21:49:47 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:48 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 1073741824" returned: 0 in 0.411s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:48 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 Sep 28 21:49:48 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:48 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77" returned: 0 in 0.253s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1341b6a-55d7-443d-9164-b226da8d6fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9547db12-e700-4724-9bd0-9e91a332fd77', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db563757-d37f-4dff-a677-ff6c8df7c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Volume volume-9547db12-e700-4724-9bd0-9e91a332fd77 (9547db12-e700-4724-9bd0-9e91a332fd77): created successfully Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db563757-d37f-4dff-a677-ff6c8df7c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Flow 'volume_create_manager' (1e4b4aa3-c547-4563-8d59-cf0de5a45919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1cc46686-1f4f-49ce-bb0f-08ddb1ebb455 tempest-VolumesListAdminTestJSON-674558893 None] Created volume successfully. Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Flow 'volume_create_manager' (31b46ab0-537e-4f7f-90a1-cc71ba316481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d94e03-ca4d-46fc-9db0-ecf13fa27760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d94e03-ca4d-46fc-9db0-ecf13fa27760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-635294092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf1f385-9ddc-4f5d-b46e-1601b18154b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e9cb6dc5f4654b86d0c5cf6ac7f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:49Z,use_quota=True,user_id='d74935a9166e4ecd8ee47333d35341ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b440017-ed99-40d1-b4a6-cef5cba7fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b440017-ed99-40d1-b4a6-cef5cba7fa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c91deeb-9218-4dc2-b2db-8fe7cce8d375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c91deeb-9218-4dc2-b2db-8fe7cce8d375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf1f385-9ddc-4f5d-b46e-1601b18154b5', 'volume_name': 'volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7c0c88-dc29-45e9-b75f-5e5179421325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7c0c88-dc29-45e9-b75f-5e5179421325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588fe59c-4688-4143-9716-65b196da2160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:49 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Volume eaf1f385-9ddc-4f5d-b46e-1601b18154b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5', 'volume_size': 1} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-635294092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf1f385-9ddc-4f5d-b46e-1601b18154b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e9cb6dc5f4654b86d0c5cf6ac7f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:49Z,use_quota=True,user_id='d74935a9166e4ecd8ee47333d35341ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Creating volume eaf1f385-9ddc-4f5d-b46e-1601b18154b5 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:49 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:49 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 1073741824 Sep 28 21:49:49 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:49 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 1073741824" returned: 0 in 0.423s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:49 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 Sep 28 21:49:49 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:49 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5" returned: 0 in 0.239s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588fe59c-4688-4143-9716-65b196da2160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e059dc-8f64-4f07-9f53-21c0086a4d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:49 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Volume volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 (eaf1f385-9ddc-4f5d-b46e-1601b18154b5): created successfully Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e059dc-8f64-4f07-9f53-21c0086a4d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Flow 'volume_create_manager' (31b46ab0-537e-4f7f-90a1-cc71ba316481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:49 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d3366cff-1d92-4ed5-a8d6-2876fb17c570 tempest-VolumesListAdminTestJSON-674558893 None] Created volume successfully. Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Flow 'volume_create_manager' (198e86e6-9b79-40f4-974e-d60b40d468f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e74371-e8bd-45cc-b17a-76a9e2c47f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e74371-e8bd-45cc-b17a-76a9e2c47f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-673964710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98761776-b37c-42da-9c46-0ab7c13d7b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e9cb6dc5f4654b86d0c5cf6ac7f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:51Z,use_quota=True,user_id='d74935a9166e4ecd8ee47333d35341ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0a1b50-96ee-4929-8bc0-c86b07d74dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0a1b50-96ee-4929-8bc0-c86b07d74dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c4197f-b50c-433c-b2f1-18ca2c8a920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c4197f-b50c-433c-b2f1-18ca2c8a920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98761776-b37c-42da-9c46-0ab7c13d7b7a', 'volume_name': 'volume-98761776-b37c-42da-9c46-0ab7c13d7b7a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326a71b5-5959-4b4f-b9d8-9777760ee86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326a71b5-5959-4b4f-b9d8-9777760ee86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a989dd3e-b0b8-410f-a209-8a4dc4800f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Volume 98761776-b37c-42da-9c46-0ab7c13d7b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98761776-b37c-42da-9c46-0ab7c13d7b7a', 'volume_size': 1} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-673964710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98761776-b37c-42da-9c46-0ab7c13d7b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e9cb6dc5f4654b86d0c5cf6ac7f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:51Z,use_quota=True,user_id='d74935a9166e4ecd8ee47333d35341ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Creating volume 98761776-b37c-42da-9c46-0ab7c13d7b7a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:50 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:50 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a 1073741824 Sep 28 21:49:50 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:51 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a 1073741824" returned: 0 in 0.403s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:51 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a Sep 28 21:49:51 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:51 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a989dd3e-b0b8-410f-a209-8a4dc4800f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98761776-b37c-42da-9c46-0ab7c13d7b7a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70011e1f-85bd-423c-badd-71f74e6e77f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:51 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Volume volume-98761776-b37c-42da-9c46-0ab7c13d7b7a (98761776-b37c-42da-9c46-0ab7c13d7b7a): created successfully Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70011e1f-85bd-423c-badd-71f74e6e77f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Flow 'volume_create_manager' (198e86e6-9b79-40f4-974e-d60b40d468f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d7272def-d027-4baa-91d8-945980aaadad tempest-VolumesListAdminTestJSON-674558893 None] Created volume successfully. Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Flow 'volume_create_manager' (861abf5a-bdc6-433d-b8c2-08f5c3fe6dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1330fd75-bb1f-43b2-9705-334bb8b17709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1330fd75-bb1f-43b2-9705-334bb8b17709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29312d5a-9b69-408b-89a1-5e5bc19f530d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651acc28ee4240bf9a36902d4d953146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:52Z,use_quota=True,user_id='febbedea2b9a4f79a8d724cfa71b9dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e659f171-a01e-4585-93c4-4ad123fbb507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e659f171-a01e-4585-93c4-4ad123fbb507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ab1432-c033-403d-bfc8-89d731c0b04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ab1432-c033-403d-bfc8-89d731c0b04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29312d5a-9b69-408b-89a1-5e5bc19f530d', 'volume_name': 'volume-29312d5a-9b69-408b-89a1-5e5bc19f530d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a670b2c9-7ef4-450d-ab2d-51639f8b6a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a670b2c9-7ef4-450d-ab2d-51639f8b6a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020418a8-180a-466a-8630-8f7d42943c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Volume 29312d5a-9b69-408b-89a1-5e5bc19f530d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29312d5a-9b69-408b-89a1-5e5bc19f530d', 'volume_size': 1} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29312d5a-9b69-408b-89a1-5e5bc19f530d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651acc28ee4240bf9a36902d4d953146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:49:52Z,use_quota=True,user_id='febbedea2b9a4f79a8d724cfa71b9dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Creating volume 29312d5a-9b69-408b-89a1-5e5bc19f530d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:49:52 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:52 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d 1073741824 Sep 28 21:49:52 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:52 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d 1073741824" returned: 0 in 0.402s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:52 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d Sep 28 21:49:52 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:53 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020418a8-180a-466a-8630-8f7d42943c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29312d5a-9b69-408b-89a1-5e5bc19f530d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4051f839-016e-47fa-ab32-cd7859be06a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:49:53 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Volume volume-29312d5a-9b69-408b-89a1-5e5bc19f530d (29312d5a-9b69-408b-89a1-5e5bc19f530d): created successfully Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4051f839-016e-47fa-ab32-cd7859be06a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Flow 'volume_create_manager' (861abf5a-bdc6-433d-b8c2-08f5c3fe6dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:49:53 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-dfc1f8be-8849-4ab9-8117-46164ff1b1eb tempest-VolumesListAdminTestJSON-1110111692 None] Created volume successfully. Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Acquiring lock "cinder-29312d5a-9b69-408b-89a1-5e5bc19f530d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Lock "cinder-29312d5a-9b69-408b-89a1-5e5bc19f530d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Acquiring lock "cinder-quobyte-29312d5a-9b69-408b-89a1-5e5bc19f530d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Lock "cinder-quobyte-29312d5a-9b69-408b-89a1-5e5bc19f530d" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[700d8048-4a79-4e97-83e1-c786804c2b4c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "cinder-98761776-b37c-42da-9c46-0ab7c13d7b7a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-98761776-b37c-42da-9c46-0ab7c13d7b7a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "cinder-quobyte-98761776-b37c-42da-9c46-0ab7c13d7b7a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-quobyte-98761776-b37c-42da-9c46-0ab7c13d7b7a" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:53 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d Sep 28 21:49:53 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b8175f-67ad-42d8-9513-c1422ecd71ad]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:53 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a Sep 28 21:49:53 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:53 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d" returned: 0 in 0.387s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:53 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d Sep 28 21:49:53 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:53 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a" returned: 0 in 0.359s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:54 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a Sep 28 21:49:54 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:54 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-29312d5a-9b69-408b-89a1-5e5bc19f530d" returned: 0 in 0.264s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Lock "cinder-quobyte-29312d5a-9b69-408b-89a1-5e5bc19f530d" released by "delete_volume" :: held 0.698s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Created reservations ['a329f8d4-5cd7-4f9e-a64c-62a979ffe7e8', '9ceed0f6-efa9-4c04-88b1-2312a30827e5', 'ecd60d21-cabd-42e4-91cc-720bc3a9e996', '7dd4a68f-e6ab-46cf-9c13-55a0fdb634bb'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:54 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-98761776-b37c-42da-9c46-0ab7c13d7b7a" returned: 0 in 0.247s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-quobyte-98761776-b37c-42da-9c46-0ab7c13d7b7a" released by "delete_volume" :: held 0.648s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:54 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:54 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Created reservations ['eaf7e633-698b-4978-abb1-45109f780aff', '03495d84-3be1-453b-9949-6bf219ed0751', 'ea678b8c-264e-40d3-b2c9-790ab8c84440', '1c4d6aeb-61a1-4a32-9f76-867c9f0261fd'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:54 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:54 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:54 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.239s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:54 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Deleted volume successfully. Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c2295022-7a2d-48ea-9199-886206bb8d88 tempest-VolumesListAdminTestJSON-1110111692 None] Lock "cinder-29312d5a-9b69-408b-89a1-5e5bc19f530d-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:54 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:54 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Deleted volume successfully. Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3d28f801-5bb6-4067-a526-15bcfdc08a71 tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-98761776-b37c-42da-9c46-0ab7c13d7b7a-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "cinder-eaf1f385-9ddc-4f5d-b46e-1601b18154b5-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-eaf1f385-9ddc-4f5d-b46e-1601b18154b5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "cinder-quobyte-eaf1f385-9ddc-4f5d-b46e-1601b18154b5" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-quobyte-eaf1f385-9ddc-4f5d-b46e-1601b18154b5" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b893d54-9dfa-45af-9925-970a1e830279]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:54 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 Sep 28 21:49:54 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:55 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5" returned: 0 in 0.354s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:55 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5 Sep 28 21:49:55 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:55 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-eaf1f385-9ddc-4f5d-b46e-1601b18154b5" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-quobyte-eaf1f385-9ddc-4f5d-b46e-1601b18154b5" released by "delete_volume" :: held 0.638s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Created reservations ['1a4a3c75-257d-4ba1-9632-4b2aaa184240', '3005d440-ff54-42aa-a8ec-210e06d474c4', '3a8cad07-e5ee-4456-9bb1-550ad7639644', 'a6bebbf4-b05e-432f-91d7-8f375f3eef1e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:55 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:55 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:55 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:55 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Deleted volume successfully. Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-710ff604-475e-43a8-99aa-ed8402821e2a tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-eaf1f385-9ddc-4f5d-b46e-1601b18154b5-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "cinder-9547db12-e700-4724-9bd0-9e91a332fd77-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-9547db12-e700-4724-9bd0-9e91a332fd77-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "cinder-quobyte-9547db12-e700-4724-9bd0-9e91a332fd77" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-quobyte-9547db12-e700-4724-9bd0-9e91a332fd77" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e6e31a-eb35-4c32-9bca-264543b5939a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:56 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 Sep 28 21:49:56 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:56 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:56 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77 Sep 28 21:49:56 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:56 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9547db12-e700-4724-9bd0-9e91a332fd77" returned: 0 in 0.248s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-quobyte-9547db12-e700-4724-9bd0-9e91a332fd77" released by "delete_volume" :: held 0.640s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Created reservations ['2c29985e-9f61-4888-80a3-3dd896875e4c', '2f4efc3b-fd3e-4ecc-a0cb-b8265249d28d', '312d2635-e39e-4ba8-b16b-a8d80701471f', 'ca206eb4-97c4-4175-b45a-c780974cd1ea'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:49:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:49:56 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:49:56 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:49:57 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Sep 28 21:49:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:49:57 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:49:57 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Deleted volume successfully. Sep 28 21:49:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1c9f9303-f84a-40e7-a289-7717597b431e tempest-VolumesListAdminTestJSON-674558893 None] Lock "cinder-9547db12-e700-4724-9bd0-9e91a332fd77-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:06 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=27,cinder:INSERT=11,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Flow 'volume_create_manager' (826a87e1-985f-4fb5-ab14-d8b6cc664f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919620ea-5dca-45af-b513-d5f1d33cc4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919620ea-5dca-45af-b513-d5f1d33cc4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-841499611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619b9ae7-e8ae-4b85-9381-c741d065d23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf224d8e96548a8833b47e936243235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:07Z,use_quota=True,user_id='daf5c806d9c9484abea79298cb49d17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47d92ac-190e-4a91-afd9-96c5a6929788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47d92ac-190e-4a91-afd9-96c5a6929788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d2c734-85b7-4087-bcb3-2c51d7005ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d2c734-85b7-4087-bcb3-2c51d7005ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619b9ae7-e8ae-4b85-9381-c741d065d23d', 'volume_name': 'volume-619b9ae7-e8ae-4b85-9381-c741d065d23d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bbf382-dd9c-4bb0-94c3-91da61fbcecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bbf382-dd9c-4bb0-94c3-91da61fbcecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b797c2-6cf5-42b5-9523-0fef82cc6a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Volume 619b9ae7-e8ae-4b85-9381-c741d065d23d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619b9ae7-e8ae-4b85-9381-c741d065d23d', 'volume_size': 1} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-841499611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619b9ae7-e8ae-4b85-9381-c741d065d23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf224d8e96548a8833b47e936243235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:07Z,use_quota=True,user_id='daf5c806d9c9484abea79298cb49d17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Creating volume 619b9ae7-e8ae-4b85-9381-c741d065d23d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:50:07 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:07 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d 1073741824 Sep 28 21:50:07 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:07 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:50:07 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:07 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d 1073741824" returned: 0 in 0.419s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:07 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d Sep 28 21:50:07 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:07 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:50:07 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d" returned: 0 in 0.254s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b797c2-6cf5-42b5-9523-0fef82cc6a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619b9ae7-e8ae-4b85-9381-c741d065d23d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a46daa5-ddee-4c06-9801-2eeb7507b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Volume volume-619b9ae7-e8ae-4b85-9381-c741d065d23d (619b9ae7-e8ae-4b85-9381-c741d065d23d): created successfully Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a46daa5-ddee-4c06-9801-2eeb7507b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Flow 'volume_create_manager' (826a87e1-985f-4fb5-ab14-d8b6cc664f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:07 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9c3c61c7-8bff-42f0-be99-1af602c2824a tempest-VolumesMetadataTest-946182711 None] Created volume successfully. Sep 28 21:50:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Acquiring lock "cinder-619b9ae7-e8ae-4b85-9381-c741d065d23d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Lock "cinder-619b9ae7-e8ae-4b85-9381-c741d065d23d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Acquiring lock "cinder-quobyte-619b9ae7-e8ae-4b85-9381-c741d065d23d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Lock "cinder-quobyte-619b9ae7-e8ae-4b85-9381-c741d065d23d" acquired by "delete_volume" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:08 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b0d6a-3391-433a-8fc1-358bb26236c2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:50:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:08 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d Sep 28 21:50:08 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:09 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d" returned: 0 in 0.364s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:09 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d Sep 28 21:50:09 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:09 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-619b9ae7-e8ae-4b85-9381-c741d065d23d" returned: 0 in 0.246s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Lock "cinder-quobyte-619b9ae7-e8ae-4b85-9381-c741d065d23d" released by "delete_volume" :: held 0.648s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Created reservations ['cf922f09-9d48-439e-92b9-a6df4c6ec350', '09a18cb3-063c-4915-989b-3ca3feb9147a', '5c609476-c3d5-4fa4-89fa-9b8400ddec06', '86bf9463-3d05-4e6a-ad05-2462d239e0ff'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:09 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:50:09 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:09 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.243s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:50:09 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Deleted volume successfully. Sep 28 21:50:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6729b9fd-8071-4720-a73b-17b4770cef62 tempest-VolumesMetadataTest-946182711 None] Lock "cinder-619b9ae7-e8ae-4b85-9381-c741d065d23d-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Flow 'volume_create_manager' (47119bd4-2b85-45b4-ba47-8609e8335560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf7a2bf-052a-479f-ba83-bdcd9333ed2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf7a2bf-052a-479f-ba83-bdcd9333ed2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1395188526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db3013a-be10-4c03-9781-536a100c9013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ce4f3298054606be279f5ba5aed0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:14Z,use_quota=True,user_id='b27d59964a0245a69f18b0e20cdf88e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecaeb77-465c-430b-af37-8406d5b0b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecaeb77-465c-430b-af37-8406d5b0b484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bce1c30-a814-49f6-b9c4-01eb01f0fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bce1c30-a814-49f6-b9c4-01eb01f0fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db3013a-be10-4c03-9781-536a100c9013', 'volume_name': 'volume-8db3013a-be10-4c03-9781-536a100c9013', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c27945e-e981-4e23-9004-ef62111b6ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c27945e-e981-4e23-9004-ef62111b6ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629dcb94-e200-4078-805c-3a40ae33527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:14 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Volume 8db3013a-be10-4c03-9781-536a100c9013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db3013a-be10-4c03-9781-536a100c9013', 'volume_size': 1} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1395188526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db3013a-be10-4c03-9781-536a100c9013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ce4f3298054606be279f5ba5aed0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:14Z,use_quota=True,user_id='b27d59964a0245a69f18b0e20cdf88e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Creating volume 8db3013a-be10-4c03-9781-536a100c9013 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:50:14 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:14 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 1073741824 Sep 28 21:50:14 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:14 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 1073741824" returned: 0 in 0.402s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:14 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 Sep 28 21:50:14 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:15 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:50:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629dcb94-e200-4078-805c-3a40ae33527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db3013a-be10-4c03-9781-536a100c9013', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1dc864-b073-4790-b69c-45e5b0786824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:15 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Volume volume-8db3013a-be10-4c03-9781-536a100c9013 (8db3013a-be10-4c03-9781-536a100c9013): created successfully Sep 28 21:50:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1dc864-b073-4790-b69c-45e5b0786824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:15 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Flow 'volume_create_manager' (47119bd4-2b85-45b4-ba47-8609e8335560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7cadfe5f-a107-4b21-becf-11126211046a tempest-VolumesTransfersTest-2088946673 None] Created volume successfully. Sep 28 21:50:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-13344e82-ce30-46b0-b97c-184d49a4ee4a tempest-VolumesTransfersTest-917314205 None] Transfer volume completed successfully. Sep 28 21:50:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Acquiring lock "cinder-8db3013a-be10-4c03-9781-536a100c9013-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Lock "cinder-8db3013a-be10-4c03-9781-536a100c9013-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Acquiring lock "cinder-quobyte-8db3013a-be10-4c03-9781-536a100c9013" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Lock "cinder-quobyte-8db3013a-be10-4c03-9781-536a100c9013" acquired by "delete_volume" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:16 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb67398-a0a9-4b88-ab91-e62d70b65d7c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:50:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:16 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 Sep 28 21:50:16 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:16 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013" returned: 0 in 0.346s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:16 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013 Sep 28 21:50:16 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:17 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8db3013a-be10-4c03-9781-536a100c9013" returned: 0 in 0.252s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Lock "cinder-quobyte-8db3013a-be10-4c03-9781-536a100c9013" released by "delete_volume" :: held 0.643s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Created reservations ['e526d7e2-e684-4289-87bd-10ea8d4042be', 'e562fdcf-58a9-4aa9-8fe4-95b57dbcd826', '31ecd30c-a9b8-41e1-b2de-b5bda5e6c439', 'ccbe22a2-fa42-401b-a65b-bc398375783e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:17 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:50:17 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:17 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.235s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:50:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Deleted volume successfully. Sep 28 21:50:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-bd6e6058-a073-497b-9165-ee62269d72d4 tempest-VolumesTransfersTest-1857574141 None] Lock "cinder-8db3013a-be10-4c03-9781-536a100c9013-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Flow 'volume_create_manager' (b67b9724-246c-4390-b8cc-d0414012dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386de7a3-bee0-46aa-9b0b-f8ea4f70cf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386de7a3-bee0-46aa-9b0b-f8ea4f70cf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-616772787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745ea5b0-28f2-44fa-b686-9248fd5b93db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ce4f3298054606be279f5ba5aed0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:18Z,use_quota=True,user_id='b27d59964a0245a69f18b0e20cdf88e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd51ff0-5a28-442d-9717-b2db7320d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd51ff0-5a28-442d-9717-b2db7320d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe438f4-996c-4456-88bf-cb84aa93c367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe438f4-996c-4456-88bf-cb84aa93c367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745ea5b0-28f2-44fa-b686-9248fd5b93db', 'volume_name': 'volume-745ea5b0-28f2-44fa-b686-9248fd5b93db', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad9df45-7b35-4ad0-a7ce-775912ff9e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad9df45-7b35-4ad0-a7ce-775912ff9e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55aa3b3-3ca8-48c9-a4d7-d227d9b2855b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:18 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Volume 745ea5b0-28f2-44fa-b686-9248fd5b93db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745ea5b0-28f2-44fa-b686-9248fd5b93db', 'volume_size': 1} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-616772787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745ea5b0-28f2-44fa-b686-9248fd5b93db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ce4f3298054606be279f5ba5aed0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:18Z,use_quota=True,user_id='b27d59964a0245a69f18b0e20cdf88e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Creating volume 745ea5b0-28f2-44fa-b686-9248fd5b93db {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:50:18 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:18 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db 1073741824 Sep 28 21:50:18 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:18 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db 1073741824" returned: 0 in 0.409s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:18 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db Sep 28 21:50:18 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:18 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55aa3b3-3ca8-48c9-a4d7-d227d9b2855b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745ea5b0-28f2-44fa-b686-9248fd5b93db', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc3f150-2e16-4be9-8dc4-940771cace0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:18 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Volume volume-745ea5b0-28f2-44fa-b686-9248fd5b93db (745ea5b0-28f2-44fa-b686-9248fd5b93db): created successfully Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc3f150-2e16-4be9-8dc4-940771cace0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:18 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Flow 'volume_create_manager' (b67b9724-246c-4390-b8cc-d0414012dc98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:18 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e1569b41-fe81-45ef-aa41-54545b2a0b55 tempest-VolumesTransfersTest-2088946673 None] Created volume successfully. Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Acquiring lock "cinder-745ea5b0-28f2-44fa-b686-9248fd5b93db-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Lock "cinder-745ea5b0-28f2-44fa-b686-9248fd5b93db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Acquiring lock "cinder-quobyte-745ea5b0-28f2-44fa-b686-9248fd5b93db" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Lock "cinder-quobyte-745ea5b0-28f2-44fa-b686-9248fd5b93db" acquired by "delete_volume" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d885c5-dca2-4bfc-bf39-9f2596921b40]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:19 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db Sep 28 21:50:19 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:19 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db" returned: 0 in 0.352s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:19 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db Sep 28 21:50:19 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:19 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-745ea5b0-28f2-44fa-b686-9248fd5b93db" returned: 0 in 0.245s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Lock "cinder-quobyte-745ea5b0-28f2-44fa-b686-9248fd5b93db" released by "delete_volume" :: held 0.638s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Created reservations ['0b3572b4-bcad-48c8-9b66-0ed43c76617e', '53acf7bf-50f6-4339-a655-21be8b0f9108', '7487fe3f-5bb7-4d40-90d4-29d7d5f5b54c', 'e343c138-77db-4b88-8c4b-125c4850a1cd'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:20 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:50:20 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:20 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.236s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:50:20 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Deleted volume successfully. Sep 28 21:50:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e447c09d-13a0-4335-8b2d-92a6fef8b2e0 tempest-VolumesTransfersTest-1857574141 None] Lock "cinder-745ea5b0-28f2-44fa-b686-9248fd5b93db-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Flow 'volume_create_manager' (4dd26382-266b-41bc-b8d8-e6d42304840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3ef47d-f4ab-4662-b607-0673c6065d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3ef47d-f4ab-4662-b607-0673c6065d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-952992463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fa936c-766a-4971-b274-aaf7734e2068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cd16c5a7d84dabbba0e1bd5b9f674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:27Z,use_quota=True,user_id='5e92a002bb014863af41edcff75bff42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae79186-f1e5-4945-9a52-b864d3bbbd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae79186-f1e5-4945-9a52-b864d3bbbd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d832db-34f6-4332-94fe-0808632dc6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d832db-34f6-4332-94fe-0808632dc6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8fa936c-766a-4971-b274-aaf7734e2068', 'volume_name': 'volume-f8fa936c-766a-4971-b274-aaf7734e2068', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f60ff0-c2e1-4dca-bfec-58d0b4184a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f60ff0-c2e1-4dca-bfec-58d0b4184a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12169e8-85cc-4f77-b403-b93e8ba5a3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Volume f8fa936c-766a-4971-b274-aaf7734e2068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8fa936c-766a-4971-b274-aaf7734e2068', 'volume_size': 1} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-952992463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fa936c-766a-4971-b274-aaf7734e2068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cd16c5a7d84dabbba0e1bd5b9f674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:27Z,use_quota=True,user_id='5e92a002bb014863af41edcff75bff42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Creating volume f8fa936c-766a-4971-b274-aaf7734e2068 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:50:27 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:27 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 1073741824 Sep 28 21:50:27 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:27 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 1073741824" returned: 0 in 0.409s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:27 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 Sep 28 21:50:27 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:27 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068" returned: 0 in 0.245s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12169e8-85cc-4f77-b403-b93e8ba5a3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fa936c-766a-4971-b274-aaf7734e2068', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c6bc50-7595-46b7-8342-39698d9396f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Volume volume-f8fa936c-766a-4971-b274-aaf7734e2068 (f8fa936c-766a-4971-b274-aaf7734e2068): created successfully Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c6bc50-7595-46b7-8342-39698d9396f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Flow 'volume_create_manager' (4dd26382-266b-41bc-b8d8-e6d42304840c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2b432b32-b4b8-4686-8749-b18dd71d3a6c tempest-VolumesTransfersV357Test-656173010 None] Created volume successfully. Sep 28 21:50:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3595f0ad-d14c-409d-af15-1b940b5d5f1a tempest-VolumesTransfersV357Test-178334152 None] Transfer volume completed successfully. Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Acquiring lock "cinder-f8fa936c-766a-4971-b274-aaf7734e2068-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Lock "cinder-f8fa936c-766a-4971-b274-aaf7734e2068-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Acquiring lock "cinder-quobyte-f8fa936c-766a-4971-b274-aaf7734e2068" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Lock "cinder-quobyte-f8fa936c-766a-4971-b274-aaf7734e2068" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[85114a16-6e7d-4083-9466-460c3236f1f8]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:29 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 Sep 28 21:50:29 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:29 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:29 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068 Sep 28 21:50:29 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:29 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f8fa936c-766a-4971-b274-aaf7734e2068" returned: 0 in 0.238s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Lock "cinder-quobyte-f8fa936c-766a-4971-b274-aaf7734e2068" released by "delete_volume" :: held 0.630s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:29 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Created reservations ['c15dab12-28aa-40db-af42-dd3140212841', '3278b10d-f107-4c3e-afc4-6048a5155d35', 'e087209a-a4c4-40e1-ac94-ebcc857118ba', '3255790d-6475-4ff8-8b62-225abf425e0e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:30 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:50:30 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:30 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.239s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:50:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Deleted volume successfully. Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0d32866a-994f-4a2c-b8f8-0ade19ef5ab6 tempest-VolumesTransfersV357Test-4824597 None] Lock "cinder-f8fa936c-766a-4971-b274-aaf7734e2068-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Flow 'volume_create_manager' (f3ae04f2-192b-4b56-96cf-b81e4ea12cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598a839a-c654-475a-ac2b-66aaec5df556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598a839a-c654-475a-ac2b-66aaec5df556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1901559816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7276cd62-0664-4ba8-b4b5-156fa59304ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cd16c5a7d84dabbba0e1bd5b9f674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:31Z,use_quota=True,user_id='5e92a002bb014863af41edcff75bff42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f384aada-b67c-4907-b593-174bfba8cb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f384aada-b67c-4907-b593-174bfba8cb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbab6564-b972-4bba-8ccd-c1d094a75cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbab6564-b972-4bba-8ccd-c1d094a75cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7276cd62-0664-4ba8-b4b5-156fa59304ee', 'volume_name': 'volume-7276cd62-0664-4ba8-b4b5-156fa59304ee', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccae7dc7-d3b5-4e56-9354-f8fdc7f1f9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccae7dc7-d3b5-4e56-9354-f8fdc7f1f9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f97a079-8312-4f55-a614-29c499a657d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Volume 7276cd62-0664-4ba8-b4b5-156fa59304ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7276cd62-0664-4ba8-b4b5-156fa59304ee', 'volume_size': 1} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1901559816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7276cd62-0664-4ba8-b4b5-156fa59304ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cd16c5a7d84dabbba0e1bd5b9f674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:31Z,use_quota=True,user_id='5e92a002bb014863af41edcff75bff42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Creating volume 7276cd62-0664-4ba8-b4b5-156fa59304ee {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:50:30 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:50:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:30 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee 1073741824 Sep 28 21:50:30 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:31 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee 1073741824" returned: 0 in 0.401s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:31 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee Sep 28 21:50:31 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:31 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee" returned: 0 in 0.236s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f97a079-8312-4f55-a614-29c499a657d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7276cd62-0664-4ba8-b4b5-156fa59304ee', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f74af9-7294-4889-ada5-0797dc07aa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Volume volume-7276cd62-0664-4ba8-b4b5-156fa59304ee (7276cd62-0664-4ba8-b4b5-156fa59304ee): created successfully Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f74af9-7294-4889-ada5-0797dc07aa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Flow 'volume_create_manager' (f3ae04f2-192b-4b56-96cf-b81e4ea12cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-41965236-b9be-43d9-98a0-93c404c955c2 tempest-VolumesTransfersV357Test-656173010 None] Created volume successfully. Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Acquiring lock "cinder-7276cd62-0664-4ba8-b4b5-156fa59304ee-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Lock "cinder-7276cd62-0664-4ba8-b4b5-156fa59304ee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Acquiring lock "cinder-quobyte-7276cd62-0664-4ba8-b4b5-156fa59304ee" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Lock "cinder-quobyte-7276cd62-0664-4ba8-b4b5-156fa59304ee" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[77105ef5-0581-4755-94ee-5ec397b7a7ba]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:32 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee Sep 28 21:50:32 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:32 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee" returned: 0 in 0.367s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:32 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee Sep 28 21:50:32 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:32 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7276cd62-0664-4ba8-b4b5-156fa59304ee" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Lock "cinder-quobyte-7276cd62-0664-4ba8-b4b5-156fa59304ee" released by "delete_volume" :: held 0.649s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Created reservations ['163f8616-b084-4009-b92f-c6b2440f2e14', 'e2bc0c5a-df1a-405b-b701-fb9d9b70d230', '218f8361-9017-4398-83ce-4ef3ebf3567d', 'dc0ace6e-9769-491b-ad74-3362f43b8e46'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:32 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:50:32 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:33 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.237s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:33 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:50:33 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Deleted volume successfully. Sep 28 21:50:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-978ff5c1-3cc0-4476-87b5-106a8a8465cc tempest-VolumesTransfersV357Test-4824597 None] Lock "cinder-7276cd62-0664-4ba8-b4b5-156fa59304ee-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:42 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=35,cinder:UPDATE=62,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:50:43 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=66,cinder:UPDATE=90,cinder:DELETE=11,cinder:INSERT=24 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Flow 'volume_create_manager' (a8f0f652-db2c-4c35-ac0d-61663c032f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e758a9-62e7-4c87-a972-6a54b05c3e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e758a9-62e7-4c87-a972-6a54b05c3e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1357363018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a39c2dd-2343-4264-86eb-c200cf58229c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a154292c08a428888952ec097c7b9a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:47Z,use_quota=True,user_id='5336861dbb264a5ba1f768c89a01baa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda37011-d62b-4b32-8a8c-480d4aee1c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda37011-d62b-4b32-8a8c-480d4aee1c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec94bf5-56fd-4efe-9ed0-781cbd3de8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec94bf5-56fd-4efe-9ed0-781cbd3de8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a39c2dd-2343-4264-86eb-c200cf58229c', 'volume_name': 'volume-9a39c2dd-2343-4264-86eb-c200cf58229c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4137493-5f8f-4e37-8565-e6e3afdeba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4137493-5f8f-4e37-8565-e6e3afdeba61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fd8373-5cfb-4904-ac75-9149e8f6772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:47 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Volume 9a39c2dd-2343-4264-86eb-c200cf58229c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a39c2dd-2343-4264-86eb-c200cf58229c', 'volume_size': 1} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1357363018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a39c2dd-2343-4264-86eb-c200cf58229c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a154292c08a428888952ec097c7b9a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:50:47Z,use_quota=True,user_id='5336861dbb264a5ba1f768c89a01baa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Creating volume 9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:50:47 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:47 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c 1073741824 Sep 28 21:50:47 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:47 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c 1073741824" returned: 0 in 0.408s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:50:47 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:50:47 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:50:47 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.238s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:50:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:50:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fd8373-5cfb-4904-ac75-9149e8f6772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a39c2dd-2343-4264-86eb-c200cf58229c', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162e7f1e-2404-4cd3-88b1-ae52d1e52415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:50:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Volume volume-9a39c2dd-2343-4264-86eb-c200cf58229c (9a39c2dd-2343-4264-86eb-c200cf58229c): created successfully Sep 28 21:50:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162e7f1e-2404-4cd3-88b1-ae52d1e52415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:50:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Flow 'volume_create_manager' (a8f0f652-db2c-4c35-ac0d-61663c032f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:50:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-31516d39-1528-4f92-8513-dc75d8abae37 tempest-VolumesActionsTest-1096024955 None] Created volume successfully. Sep 28 21:50:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9e7aa603-72de-4d8c-957f-c6a14fbb7cd0 tempest-VolumesActionsTest-1096024955 None] Acquiring lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c" by "attach_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9e7aa603-72de-4d8c-957f-c6a14fbb7cd0 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c" acquired by "attach_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:55 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9e7aa603-72de-4d8c-957f-c6a14fbb7cd0 tempest-VolumesActionsTest-1096024955 None] Attaching volume 9a39c2dd-2343-4264-86eb-c200cf58229c to instance 35ced74a-b849-4e1f-8261-59e83b910064 at mountpoint /dev/vdb on host None. Sep 28 21:50:55 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9e7aa603-72de-4d8c-957f-c6a14fbb7cd0 tempest-VolumesActionsTest-1096024955 None] Attach volume completed successfully. Sep 28 21:50:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9e7aa603-72de-4d8c-957f-c6a14fbb7cd0 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c" released by "attach_volume" :: held 0.092s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:50:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df80490a-ba87-4ff5-9519-a1b48e5f799c tempest-VolumesActionsTest-1096024955 None] Acquiring lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-detach_volume" by "detach_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:50:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df80490a-ba87-4ff5-9519-a1b48e5f799c tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:50:55 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-df80490a-ba87-4ff5-9519-a1b48e5f799c tempest-VolumesActionsTest-1096024955 None] Detaching volume 9a39c2dd-2343-4264-86eb-c200cf58229c from instance 35ced74a-b849-4e1f-8261-59e83b910064. Sep 28 21:50:55 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-df80490a-ba87-4ff5-9519-a1b48e5f799c tempest-VolumesActionsTest-1096024955 None] Detach volume completed successfully. Sep 28 21:50:55 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df80490a-ba87-4ff5-9519-a1b48e5f799c tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:51:05 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:51:05 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:51:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7e75303-ba62-47af-9e24-691cec983971 tempest-VolumesActionsTest-1096024955 None] Acquiring lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c" by "attach_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:51:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7e75303-ba62-47af-9e24-691cec983971 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c" acquired by "attach_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:51:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a7e75303-ba62-47af-9e24-691cec983971 tempest-VolumesActionsTest-1096024955 None] Attaching volume 9a39c2dd-2343-4264-86eb-c200cf58229c to instance 54fe4b61-9a83-4f31-9039-108c3372ec0a at mountpoint /dev/vdb on host None. Sep 28 21:51:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a7e75303-ba62-47af-9e24-691cec983971 tempest-VolumesActionsTest-1096024955 None] Attach volume completed successfully. Sep 28 21:51:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a7e75303-ba62-47af-9e24-691cec983971 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c" released by "attach_volume" :: held 0.093s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:51:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eab79c69-2a68-41a1-9bc1-b7a8fd297c63 tempest-VolumesActionsTest-1096024955 None] Acquiring lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-detach_volume" by "detach_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:51:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eab79c69-2a68-41a1-9bc1-b7a8fd297c63 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:51:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-eab79c69-2a68-41a1-9bc1-b7a8fd297c63 tempest-VolumesActionsTest-1096024955 None] Detaching volume 9a39c2dd-2343-4264-86eb-c200cf58229c from instance 54fe4b61-9a83-4f31-9039-108c3372ec0a. Sep 28 21:51:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-eab79c69-2a68-41a1-9bc1-b7a8fd297c63 tempest-VolumesActionsTest-1096024955 None] Detach volume completed successfully. Sep 28 21:51:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-eab79c69-2a68-41a1-9bc1-b7a8fd297c63 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:07 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:51:07 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:07 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.278s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:51:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:51:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:51:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:51:10 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdfb8e7-8122-4e12-996a-db63fdc0bc7d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:10 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:51:10 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:11 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.353s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:11 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e9548-8b8a-474c-bb73-2f8be84f3fbc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:11 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:51:11 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:11 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.352s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.0ad89905-c9ed-402e-b6d8-bc7914933801vvgn9_d3.img {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:11 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.0ad89905-c9ed-402e-b6d8-bc7914933801vvgn9_d3.img Sep 28 21:51:11 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:17 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.0ad89905-c9ed-402e-b6d8-bc7914933801vvgn9_d3.img" returned: 0 in 5.649s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c345df-ce29-4c18-a450-7e90b69e9a7b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:17 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:51:17 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:17 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.510s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:17 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.0ad89905-c9ed-402e-b6d8-bc7914933801vvgn9_d3.img {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:51:17 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Converted 1024.00 MB image at 181.23 MB/s Sep 28 21:51:17 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] 0ad89905-c9ed-402e-b6d8-bc7914933801 was raw, no need to convert to raw {{(pid=86489) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 21:51:27 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:51:27 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:INSERT=1,cinder:SELECT=10,cinder:UPDATE=4 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:51:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.472s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:51:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Uploaded volume to glance image-id: 0ad89905-c9ed-402e-b6d8-bc7914933801. {{(pid=86489) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 21:51:36 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-eabc1690-1225-46e6-aff9-8f5542e958ba tempest-VolumesActionsTest-1096024955 None] Copy volume to image completed successfully. Sep 28 21:51:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:51:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:51:37 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9484fc-62dc-4c04-ba8d-16fea292a16e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:37 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:51:37 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:37 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.360s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:37 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[12904ca7-41ac-45cf-8ce4-fbcf14c6d4c7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:37 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:51:37 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:38 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.362s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:38 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img Sep 28 21:51:38 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:43 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img" returned: 0 in 5.688s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[839adedc-1ba3-4365-ab05-1106fa9b8cf3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:43 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:51:43 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:44 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.502s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:51:44 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Converted 1024.00 MB image at 179.97 MB/s Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] 4689e5a2-bef5-4d11-ae9d-27623741f197 was raw, converting to qcow2 {{(pid=86489) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[323b3368-66f9-47b9-a0aa-3ca100746f10]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:44 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img Sep 28 21:51:44 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:44 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img" returned: 0 in 0.316s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:44 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img Sep 28 21:51:44 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:44 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img" returned: 1 in 0.316s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:51:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img /opt/stack/data/cinder/conversion/vol_upload_wyw1s8v3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:44 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img /opt/stack/data/cinder/conversion/vol_upload_wyw1s8v3 Sep 28 21:51:44 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:45 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img /opt/stack/data/cinder/conversion/vol_upload_wyw1s8v3" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:45 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Image conversion details: src /opt/stack/data/cinder/conversion/9a39c2dd-2343-4264-86eb-c200cf58229c.temp_image.4689e5a2-bef5-4d11-ae9d-27623741f197b_7f41p6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wyw1s8v3 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:51:45 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 21:51:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8669026f-5770-4a46-b29d-3a09dde6c225]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wyw1s8v3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:45 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wyw1s8v3 Sep 28 21:51:45 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:45 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wyw1s8v3" returned: 0 in 0.315s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.379s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:51:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Uploaded volume to glance image-id: 4689e5a2-bef5-4d11-ae9d-27623741f197. {{(pid=86489) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 21:51:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2a168164-75dc-400e-8323-dd657c7cc20e tempest-VolumesActionsTest-1096024955 None] Copy volume to image completed successfully. Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Acquiring lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Acquiring lock "cinder-quobyte-9a39c2dd-2343-4264-86eb-c200cf58229c" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-quobyte-9a39c2dd-2343-4264-86eb-c200cf58229c" acquired by "delete_volume" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e696f24-5aac-485c-bbc8-6f2558987400]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:48 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:51:48 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:48 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.345s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:48 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c Sep 28 21:51:48 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:48 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9a39c2dd-2343-4264-86eb-c200cf58229c" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-quobyte-9a39c2dd-2343-4264-86eb-c200cf58229c" released by "delete_volume" :: held 0.624s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Created reservations ['9c4854e7-7264-463c-b045-7e0fbee75d11', 'af9458c5-b575-4e7f-aa37-9675f4a35530', 'cb5d7399-e3d2-4ab0-bb25-c1b3526dbcdd', '34f0ee06-65d8-45c3-ae7d-da907a3ec016'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:51:49 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:51:49 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:51:49 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.240s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:51:49 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Deleted volume successfully. Sep 28 21:51:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-937ed917-1c69-4e2d-a0b6-bf814e0de812 tempest-VolumesActionsTest-1096024955 None] Lock "cinder-9a39c2dd-2343-4264-86eb-c200cf58229c-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:51:59 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:51:59 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:52:07 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:52:07 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:52:07 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.300s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:52:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Flow 'volume_create_manager' (18ace7d3-fe82-4949-84e5-a1bab15db2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b614a0e-d40a-4ea7-b573-495e1d290a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b614a0e-d40a-4ea7-b573-495e1d290a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-56602144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd39bbb5-e647-4924-9354-6fc62e0737ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42129d1f9f8244b0a1608142068b5af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:52:42Z,use_quota=True,user_id='35e73c5c4de5484397bdb85435b95e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abfc273-8bac-408c-8b87-e2feba505c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abfc273-8bac-408c-8b87-e2feba505c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e259e64-1e54-42d6-a5ae-9132b7fad2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e259e64-1e54-42d6-a5ae-9132b7fad2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd39bbb5-e647-4924-9354-6fc62e0737ac', 'volume_name': 'volume-bd39bbb5-e647-4924-9354-6fc62e0737ac', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486171c7-8d99-40b9-9db6-4402ce91ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486171c7-8d99-40b9-9db6-4402ce91ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7b6cb3-b29a-4775-8efc-da164e1ac654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:52:41 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Volume bd39bbb5-e647-4924-9354-6fc62e0737ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd39bbb5-e647-4924-9354-6fc62e0737ac', 'volume_size': 1} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-56602144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd39bbb5-e647-4924-9354-6fc62e0737ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42129d1f9f8244b0a1608142068b5af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:52:42Z,use_quota=True,user_id='35e73c5c4de5484397bdb85435b95e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Creating volume bd39bbb5-e647-4924-9354-6fc62e0737ac {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:52:41 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:52:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:52:41 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac 1073741824 Sep 28 21:52:41 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:52:42 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac 1073741824" returned: 0 in 0.406s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:52:42 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac Sep 28 21:52:42 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:52:42 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac" returned: 0 in 0.240s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7b6cb3-b29a-4775-8efc-da164e1ac654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd39bbb5-e647-4924-9354-6fc62e0737ac', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687f0735-1b8a-4496-9865-ab3295cbc1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:52:42 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Volume volume-bd39bbb5-e647-4924-9354-6fc62e0737ac (bd39bbb5-e647-4924-9354-6fc62e0737ac): created successfully Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687f0735-1b8a-4496-9865-ab3295cbc1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:52:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Flow 'volume_create_manager' (18ace7d3-fe82-4949-84e5-a1bab15db2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:52:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-993ff648-beb3-41bd-aa21-d0357a17c2ee tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Created volume successfully. Sep 28 21:52:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-cf1ca72c-3ea8-492a-939a-6108c9371a5d req-fc239c78-d6ef-4598-820d-a1d9e9de168c tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:52:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-cf1ca72c-3ea8-492a-939a-6108c9371a5d req-fc239c78-d6ef-4598-820d-a1d9e9de168c tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:52:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [req-cf1ca72c-3ea8-492a-939a-6108c9371a5d req-fc239c78-d6ef-4598-820d-a1d9e9de168c tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:52:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-cf1ca72c-3ea8-492a-939a-6108c9371a5d req-fc239c78-d6ef-4598-820d-a1d9e9de168c tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73', 'name': 'volume-bd39bbb5-e647-4924-9354-6fc62e0737ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7904b59e-b456-4134-a872-0836233029d6', 'enforce_multipath': True} {{(pid=86489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 21:52:43 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-cf1ca72c-3ea8-492a-939a-6108c9371a5d req-fc239c78-d6ef-4598-820d-a1d9e9de168c tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] attachment_update completed successfully. Sep 28 21:52:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [req-df6efced-cb0d-40e5-adee-692489128495 req-f7d5442a-bf75-43fb-a69b-04657b040cb3 tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Terminate volume connection completed successfully. Sep 28 21:52:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [req-df6efced-cb0d-40e5-adee-692489128495 req-f7d5442a-bf75-43fb-a69b-04657b040cb3 tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Deleting attachment 7904b59e-b456-4134-a872-0836233029d6. {{(pid=86489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 21:52:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Acquiring lock "cinder-bd39bbb5-e647-4924-9354-6fc62e0737ac-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:52:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "cinder-bd39bbb5-e647-4924-9354-6fc62e0737ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:52:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Acquiring lock "cinder-quobyte-bd39bbb5-e647-4924-9354-6fc62e0737ac" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:52:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "cinder-quobyte-bd39bbb5-e647-4924-9354-6fc62e0737ac" acquired by "delete_volume" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:52:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[612eb74f-094f-4e80-ba18-4ad11c778443]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:52:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:52:47 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac Sep 28 21:52:47 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:52:47 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 28 21:52:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac" returned: 0 in 0.349s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:52:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:52:47 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac Sep 28 21:52:47 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:52:48 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bd39bbb5-e647-4924-9354-6fc62e0737ac" returned: 0 in 0.244s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "cinder-quobyte-bd39bbb5-e647-4924-9354-6fc62e0737ac" released by "delete_volume" :: held 0.632s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Created reservations ['4e52acf2-0cab-490b-b900-e89cf1458a18', 'b38aad96-6ba1-44fb-b2a4-9703519f8c1c', '49eb0ccd-c95e-4a3f-9fd7-9bc6de9a0db3', 'e701c0f8-1e10-4c8e-b520-2f5fb8d39e66'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:52:48 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:52:48 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:52:48 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:52:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Deleted volume successfully. Sep 28 21:52:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a3fd6d3-0a4d-4065-a280-35c63dd33aac tempest-TestServerVolumeAttachScenarioOldVersion-2053965869 None] Lock "cinder-bd39bbb5-e647-4924-9354-6fc62e0737ac-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:52:58 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:52:58 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:07 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:53:07 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:07 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.279s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:53:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Flow 'volume_create_manager' (2842efda-78cd-4aad-af7f-685faa2b78e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4d4681-fabb-48ed-83fc-cdd785c613db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4d4681-fabb-48ed-83fc-cdd785c613db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-127299666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8c8f0c-46ba-4795-a874-dbef5562f6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c04d88696a4acd81cd3ca048bfbe68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:53:22Z,use_quota=True,user_id='6e78dfd077414e25bc7dad1dae827ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9e187a-1247-43a3-a05c-752cc07a35a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9e187a-1247-43a3-a05c-752cc07a35a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b686ce-95d4-49b2-92a2-7f7e6cd01b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b686ce-95d4-49b2-92a2-7f7e6cd01b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8c8f0c-46ba-4795-a874-dbef5562f6e6', 'volume_name': 'volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dd8932-3e50-40c5-a9c2-2fdb63c82538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dd8932-3e50-40c5-a9c2-2fdb63c82538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d01cfc-dabc-4b10-95e0-de9341a719e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:53:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Volume 4e8c8f0c-46ba-4795-a874-dbef5562f6e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6', 'volume_size': 1} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-127299666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8c8f0c-46ba-4795-a874-dbef5562f6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c04d88696a4acd81cd3ca048bfbe68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:53:22Z,use_quota=True,user_id='6e78dfd077414e25bc7dad1dae827ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Creating volume 4e8c8f0c-46ba-4795-a874-dbef5562f6e6 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:53:21 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:53:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:21 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 1073741824 Sep 28 21:53:21 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:22 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 1073741824" returned: 0 in 0.414s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:22 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 Sep 28 21:53:22 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:22 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d01cfc-dabc-4b10-95e0-de9341a719e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1735c9a6-3fd4-4085-8c02-885927b28014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:53:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Volume volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 (4e8c8f0c-46ba-4795-a874-dbef5562f6e6): created successfully Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1735c9a6-3fd4-4085-8c02-885927b28014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:53:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Flow 'volume_create_manager' (2842efda-78cd-4aad-af7f-685faa2b78e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:53:22 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d141fa10-4ec0-4006-b291-2d6047675da7 tempest-TestImageHashVerification-1255533006 None] Created volume successfully. Sep 28 21:53:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:53:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:53:23 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d09196-c390-49ff-854f-1232e3282647]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:53:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:23 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 Sep 28 21:53:23 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:23 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" returned: 0 in 0.368s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:23 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[722310d8-b892-4392-a07e-08335def8415]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:53:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:23 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 Sep 28 21:53:23 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:24 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" returned: 0 in 0.368s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 /opt/stack/data/cinder/conversion/4e8c8f0c-46ba-4795-a874-dbef5562f6e6.temp_image.2ac6f092-e5d8-44fb-a4a3-c79dafc61eda2aofz6z7.img {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:24 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 /opt/stack/data/cinder/conversion/4e8c8f0c-46ba-4795-a874-dbef5562f6e6.temp_image.2ac6f092-e5d8-44fb-a4a3-c79dafc61eda2aofz6z7.img Sep 28 21:53:24 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:30 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 /opt/stack/data/cinder/conversion/4e8c8f0c-46ba-4795-a874-dbef5562f6e6.temp_image.2ac6f092-e5d8-44fb-a4a3-c79dafc61eda2aofz6z7.img" returned: 0 in 6.019s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:30 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[98799a3b-56bc-4a17-8a03-fbfc2168c1e7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:53:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:30 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 Sep 28 21:53:30 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:30 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" returned: 0 in 0.549s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:30 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/conversion/4e8c8f0c-46ba-4795-a874-dbef5562f6e6.temp_image.2ac6f092-e5d8-44fb-a4a3-c79dafc61eda2aofz6z7.img {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:53:30 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Converted 1024.00 MB image at 170.11 MB/s Sep 28 21:53:30 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] 2ac6f092-e5d8-44fb-a4a3-c79dafc61eda was raw, no need to convert to raw {{(pid=86489) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 21:53:33 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:SELECT=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:53:40 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:53:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.483s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:53:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Uploaded volume to glance image-id: 2ac6f092-e5d8-44fb-a4a3-c79dafc61eda. {{(pid=86489) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 21:53:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d36970ea-6f77-430f-84d6-156dc76a238d tempest-TestImageHashVerification-1255533006 None] Copy volume to image completed successfully. Sep 28 21:53:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Acquiring lock "cinder-4e8c8f0c-46ba-4795-a874-dbef5562f6e6-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:53:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Lock "cinder-4e8c8f0c-46ba-4795-a874-dbef5562f6e6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:53:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Acquiring lock "cinder-quobyte-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:53:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Lock "cinder-quobyte-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" acquired by "delete_volume" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:53:49 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a36e7be-4a82-4c0a-81f3-487addfb4fb8]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:53:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:49 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 Sep 28 21:53:49 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:50 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" returned: 0 in 0.346s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:50 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6 Sep 28 21:53:50 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:50 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Lock "cinder-quobyte-4e8c8f0c-46ba-4795-a874-dbef5562f6e6" released by "delete_volume" :: held 0.633s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Created reservations ['7f585bf8-5502-4182-8c57-94e7630a2caf', 'b06df165-0b22-41a1-8b90-213db72398bf', '9482d2bb-123d-4000-a32e-10978dda4448', 'f4d96e68-faf9-4d18-a811-93c9d6a9cf6c'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:53:50 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:53:50 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:53:50 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.243s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:53:50 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Deleted volume successfully. Sep 28 21:53:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-da67835d-6c7c-44fe-9009-5acb9c063f83 tempest-TestImageHashVerification-1255533006 None] Lock "cinder-4e8c8f0c-46ba-4795-a874-dbef5562f6e6-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:00 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=12,cinder:SELECT=4,cinder:INSERT=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:54:00 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Flow 'volume_create_manager' (f1eb3f12-2aca-48a9-8fa6-6b0bee9d46be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1f1da-61b6-42ec-b1ed-9fd04bb1ab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1f1da-61b6-42ec-b1ed-9fd04bb1ab3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801368539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5fffe7-c8e8-4309-9aa9-14b3194d78ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f70a910ca24fa29dff871ad70b704c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:03Z,use_quota=True,user_id='dd8de7f66cd245b6b3328f7e1993f659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c24042a-8bb1-4261-b2e7-a81e79f618c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c24042a-8bb1-4261-b2e7-a81e79f618c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7ab218-7275-4492-a347-29b00aa3006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7ab218-7275-4492-a347-29b00aa3006d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5fffe7-c8e8-4309-9aa9-14b3194d78ea', 'volume_name': 'volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b6df72-dadf-4a11-be62-3979876b3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b6df72-dadf-4a11-be62-3979876b3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aec8278-681a-499e-9b5a-adc698f5b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:03 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Volume 6f5fffe7-c8e8-4309-9aa9-14b3194d78ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea', 'volume_size': 1} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801368539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5fffe7-c8e8-4309-9aa9-14b3194d78ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f70a910ca24fa29dff871ad70b704c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:03Z,use_quota=True,user_id='dd8de7f66cd245b6b3328f7e1993f659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Creating volume 6f5fffe7-c8e8-4309-9aa9-14b3194d78ea {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:03 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:03 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea 1073741824 Sep 28 21:54:03 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:03 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea 1073741824" returned: 0 in 0.411s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:03 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea Sep 28 21:54:03 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:03 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aec8278-681a-499e-9b5a-adc698f5b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05e8790-1756-4053-b6f6-83990019bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:03 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Volume volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea (6f5fffe7-c8e8-4309-9aa9-14b3194d78ea): created successfully Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05e8790-1756-4053-b6f6-83990019bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Flow 'volume_create_manager' (f1eb3f12-2aca-48a9-8fa6-6b0bee9d46be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:03 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e4520b7b-565a-4fae-a4bb-37039062e409 tempest-ProjectReaderTests-1755096619 None] Created volume successfully. Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "cinder-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Lock "cinder-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "cinder-quobyte-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Lock "cinder-quobyte-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7791c01-a5f9-429d-8fa9-836f88effe94]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:04 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea Sep 28 21:54:04 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:04 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea" returned: 0 in 0.354s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:04 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea Sep 28 21:54:04 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:04 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Lock "cinder-quobyte-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea" released by "delete_volume" :: held 0.635s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Created reservations ['4d55dcdf-7dff-4dac-918c-c9e9a319270d', 'c34db83f-2fa9-441e-a47b-313acadb2c7b', '9ede7ba2-c7ed-4ac9-94ad-fe07a00a34fd', '3a05126c-1bf4-4335-b59b-873f928dc63b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:05 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:05 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:05 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.238s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Deleted volume successfully. Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8bae9001-0abb-4a06-bf01-1ee812492fa5 tempest-ProjectReaderTests-1755096619 None] Lock "cinder-6f5fffe7-c8e8-4309-9aa9-14b3194d78ea-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Flow 'volume_create_manager' (79d305c8-e8a6-4995-a00e-3af38b691475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764f19d5-94e8-4906-8d3b-a642a76912f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764f19d5-94e8-4906-8d3b-a642a76912f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762519801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9546245f-4a49-4f04-a504-c88ce37b2c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f70a910ca24fa29dff871ad70b704c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:06Z,use_quota=True,user_id='dd8de7f66cd245b6b3328f7e1993f659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27dbfbdf-8b67-4d5b-a3c8-ddca38289dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27dbfbdf-8b67-4d5b-a3c8-ddca38289dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd02ae0-2608-4682-8521-8d7dc8191bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd02ae0-2608-4682-8521-8d7dc8191bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9546245f-4a49-4f04-a504-c88ce37b2c6a', 'volume_name': 'volume-9546245f-4a49-4f04-a504-c88ce37b2c6a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd11ca2-30f3-4eac-8f45-83341b152ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd11ca2-30f3-4eac-8f45-83341b152ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccd3698-0fea-4cf3-8a73-b2ef5a9e6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:05 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Volume 9546245f-4a49-4f04-a504-c88ce37b2c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9546245f-4a49-4f04-a504-c88ce37b2c6a', 'volume_size': 1} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762519801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9546245f-4a49-4f04-a504-c88ce37b2c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f70a910ca24fa29dff871ad70b704c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:06Z,use_quota=True,user_id='dd8de7f66cd245b6b3328f7e1993f659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Creating volume 9546245f-4a49-4f04-a504-c88ce37b2c6a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:05 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:05 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a 1073741824 Sep 28 21:54:05 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:06 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a 1073741824" returned: 0 in 0.409s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:06 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a Sep 28 21:54:06 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:06 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a" returned: 0 in 0.240s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccd3698-0fea-4cf3-8a73-b2ef5a9e6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9546245f-4a49-4f04-a504-c88ce37b2c6a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35534c69-03e9-47c3-a1f8-d35a37432671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:06 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Volume volume-9546245f-4a49-4f04-a504-c88ce37b2c6a (9546245f-4a49-4f04-a504-c88ce37b2c6a): created successfully Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35534c69-03e9-47c3-a1f8-d35a37432671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Flow 'volume_create_manager' (79d305c8-e8a6-4995-a00e-3af38b691475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-97a3ee4a-e42a-46e1-8555-32232d86fbd1 tempest-ProjectReaderTests-1755096619 None] Created volume successfully. Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "cinder-9546245f-4a49-4f04-a504-c88ce37b2c6a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Lock "cinder-9546245f-4a49-4f04-a504-c88ce37b2c6a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "cinder-quobyte-9546245f-4a49-4f04-a504-c88ce37b2c6a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Lock "cinder-quobyte-9546245f-4a49-4f04-a504-c88ce37b2c6a" acquired by "delete_volume" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f476ea75-8f0e-4ef9-b95a-417bdfd6f4db]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:07 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a Sep 28 21:54:07 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:07 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a" returned: 0 in 0.354s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:07 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a Sep 28 21:54:07 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:07 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:07 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:07 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9546245f-4a49-4f04-a504-c88ce37b2c6a" returned: 0 in 0.247s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Lock "cinder-quobyte-9546245f-4a49-4f04-a504-c88ce37b2c6a" released by "delete_volume" :: held 0.642s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Created reservations ['4bd5d55a-fa72-446e-91a9-bc143d86d3f9', '4153b3c1-9c2b-427c-a4c3-d4d7366d593b', '714e6acc-22c4-4270-947a-f018aa3188c4', '7a3c3c30-fddc-4679-9e12-da3944fc98c6'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:07 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.253s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:54:07 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:07 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:07 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.248s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:07 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Deleted volume successfully. Sep 28 21:54:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8adc661e-4d1b-4296-a3b0-ac5b4596a915 tempest-ProjectReaderTests-1755096619 None] Lock "cinder-9546245f-4a49-4f04-a504-c88ce37b2c6a-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:17 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=14,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:54:17 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=22,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (9d3e3df2-7cf1-4041-a827-c39ebfe09b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e94b04-1bdd-4d35-93df-c9a7b0a1a94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e94b04-1bdd-4d35-93df-c9a7b0a1a94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1947354565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:20Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d658cd-8860-4def-b957-b8012958e25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d658cd-8860-4def-b957-b8012958e25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73137b78-ca49-40ad-947e-8fdb67f07cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73137b78-ca49-40ad-947e-8fdb67f07cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2', 'volume_name': 'volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba42871-0c7e-45ef-a14c-8db9d231cf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba42871-0c7e-45ef-a14c-8db9d231cf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09ecc58-34c2-4b17-a4e2-cc9a5f6e394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2', 'volume_size': 1} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1947354565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:20Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Creating volume f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:20 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:20 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 1073741824 Sep 28 21:54:20 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (6672ed86-fb00-4517-a5c5-34653a383bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0371f4aa-22ec-469a-9e58-efba497074a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0371f4aa-22ec-469a-9e58-efba497074a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-812680451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef38045-fecd-4d5e-ab73-60c9b2068c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:20Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6aa82a-8d8a-4d03-bab5-7f172c88f4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6aa82a-8d8a-4d03-bab5-7f172c88f4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fe3cf6-00bf-4256-93f6-dc57b38b4e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fe3cf6-00bf-4256-93f6-dc57b38b4e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef38045-fecd-4d5e-ab73-60c9b2068c11', 'volume_name': 'volume-bef38045-fecd-4d5e-ab73-60c9b2068c11', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74da4dd-6de6-44f1-84a2-d50ffa05e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74da4dd-6de6-44f1-84a2-d50ffa05e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f134af77-fe2f-464f-9cbb-70227126f92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume bef38045-fecd-4d5e-ab73-60c9b2068c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef38045-fecd-4d5e-ab73-60c9b2068c11', 'volume_size': 1} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (c8a7cafb-40f3-4781-b49d-4a4d79224dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d8b2b7-9880-4680-8ecc-bde07e2befaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d8b2b7-9880-4680-8ecc-bde07e2befaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1290643352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163f88eb-a308-40c0-892e-5271d38a8b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:21Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1b3005-746e-48f8-889d-14207ea98469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1b3005-746e-48f8-889d-14207ea98469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad348061-da4b-4624-b78c-78b407c140f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad348061-da4b-4624-b78c-78b407c140f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163f88eb-a308-40c0-892e-5271d38a8b73', 'volume_name': 'volume-163f88eb-a308-40c0-892e-5271d38a8b73', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c414b60-052b-4114-8455-cee44ee8c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c414b60-052b-4114-8455-cee44ee8c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0be6b27-3ed5-4e71-826e-e393f3ffd4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:20 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Volume 163f88eb-a308-40c0-892e-5271d38a8b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163f88eb-a308-40c0-892e-5271d38a8b73', 'volume_size': 1} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:20 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 1073741824" returned: 0 in 0.579s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:20 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 Sep 28 21:54:20 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:21 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (01c0e83d-e305-4124-b2ba-e65c55d2f9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bbaa6e-dd40-45c4-b4cb-2f56d1451fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" returned: 0 in 0.345s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-812680451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef38045-fecd-4d5e-ab73-60c9b2068c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:20Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Creating volume bef38045-fecd-4d5e-ab73-60c9b2068c11 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:21 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bbaa6e-dd40-45c4-b4cb-2f56d1451fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-272258071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a409b8a-07e9-4ece-aff7-4f08e7f8eadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:21Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 1073741824 Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5383da82-7533-4496-86d9-c624c2d4b2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5383da82-7533-4496-86d9-c624c2d4b2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0124a8-77f4-45e1-848f-00a9fa8c801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0124a8-77f4-45e1-848f-00a9fa8c801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a409b8a-07e9-4ece-aff7-4f08e7f8eadf', 'volume_name': 'volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3433e464-123f-485d-bc70-c0726b1deb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3433e464-123f-485d-bc70-c0726b1deb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbdceda-4cf9-4cb9-a4bc-50ade6f0185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Volume 6a409b8a-07e9-4ece-aff7-4f08e7f8eadf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf', 'volume_size': 1} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09ecc58-34c2-4b17-a4e2-cc9a5f6e394f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1800d484-1572-4a6b-a8ce-7e9866dd8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 (f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2): created successfully Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1800d484-1572-4a6b-a8ce-7e9866dd8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (9d3e3df2-7cf1-4041-a827-c39ebfe09b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:21 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-51457ea3-4e71-49ef-bfd5-cc33d007209a tempest-CreateVolumesFromSnapshotTest-225403594 None] Created volume successfully. Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (9fc93919-de59-494b-859d-c8b341198ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a0432d-d183-4bd5-b17c-4a8ca4a63270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a0432d-d183-4bd5-b17c-4a8ca4a63270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079289952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc0b49f-2edb-4df4-acdf-0d1fe0b8f705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:21Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85d153b-9f50-43ce-9efa-0fe89ad91f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85d153b-9f50-43ce-9efa-0fe89ad91f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ac00bc-84c5-45b4-8705-5eca4f77146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ac00bc-84c5-45b4-8705-5eca4f77146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc0b49f-2edb-4df4-acdf-0d1fe0b8f705', 'volume_name': 'volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031faa2d-9394-4fc4-89d2-75eacdc3539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031faa2d-9394-4fc4-89d2-75eacdc3539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db4d276-9a15-4ce6-b821-7d0113b4b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Volume efc0b49f-2edb-4df4-acdf-0d1fe0b8f705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705', 'volume_size': 1} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:21 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 1073741824" returned: 0 in 0.575s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:21 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 Sep 28 21:54:21 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (ae256c5b-158c-41cd-8e5e-04f9ce10f852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76c77a2-2a05-416d-8806-62370f633227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76c77a2-2a05-416d-8806-62370f633227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1657663994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97805dc-9826-4c90-9dd9-823d93ee2a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:22Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a06189-f831-4568-97b9-c8c312855583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a06189-f831-4568-97b9-c8c312855583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb8c64f-c24c-46d3-85e8-9d471b8c2a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb8c64f-c24c-46d3-85e8-9d471b8c2a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97805dc-9826-4c90-9dd9-823d93ee2a61', 'volume_name': 'volume-b97805dc-9826-4c90-9dd9-823d93ee2a61', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767330e2-297d-4d42-93fa-14e40d89dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767330e2-297d-4d42-93fa-14e40d89dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c0fc02-92d5-4044-beff-0679663fc4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Volume b97805dc-9826-4c90-9dd9-823d93ee2a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97805dc-9826-4c90-9dd9-823d93ee2a61', 'volume_size': 1} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11" returned: 0 in 0.388s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1290643352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163f88eb-a308-40c0-892e-5271d38a8b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:21Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Creating volume 163f88eb-a308-40c0-892e-5271d38a8b73 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:22 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:22 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 1073741824 Sep 28 21:54:22 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f134af77-fe2f-464f-9cbb-70227126f92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef38045-fecd-4d5e-ab73-60c9b2068c11', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab219d01-e0a1-4e15-8380-ef299000f9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 (bef38045-fecd-4d5e-ab73-60c9b2068c11): created successfully Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab219d01-e0a1-4e15-8380-ef299000f9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (6672ed86-fb00-4517-a5c5-34653a383bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:22 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fdeda4c5-63b1-4ef4-8daf-3b7a9530c6f4 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created volume successfully. Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (f632d722-c469-41d6-9a1b-bef092638848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a4a9d2-9672-453f-997a-4eb8d3cd2a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a4a9d2-9672-453f-997a-4eb8d3cd2a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1329159141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ada383-0cd6-42ab-8e84-9569bca8358d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:22Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d411526f-e6b7-4980-806c-1302c677586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d411526f-e6b7-4980-806c-1302c677586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a22f53-72cb-4f75-9e6c-3a334542184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a22f53-72cb-4f75-9e6c-3a334542184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ada383-0cd6-42ab-8e84-9569bca8358d', 'volume_name': 'volume-48ada383-0cd6-42ab-8e84-9569bca8358d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4816cdca-51f4-44ec-b6ea-ef742de77cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4816cdca-51f4-44ec-b6ea-ef742de77cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7dd589-3c54-40dc-97e6-8830738249c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Volume 48ada383-0cd6-42ab-8e84-9569bca8358d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ada383-0cd6-42ab-8e84-9569bca8358d', 'volume_size': 1} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:22 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 1073741824" returned: 0 in 0.566s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:22 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 Sep 28 21:54:22 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:23 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-272258071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a409b8a-07e9-4ece-aff7-4f08e7f8eadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:21Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Creating volume 6a409b8a-07e9-4ece-aff7-4f08e7f8eadf {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:23 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0be6b27-3ed5-4e71-826e-e393f3ffd4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163f88eb-a308-40c0-892e-5271d38a8b73', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:23 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf 1073741824 Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b8880b-1417-48d2-9cac-f07013ea3c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:23 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:23 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Volume volume-163f88eb-a308-40c0-892e-5271d38a8b73 (163f88eb-a308-40c0-892e-5271d38a8b73): created successfully Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b8880b-1417-48d2-9cac-f07013ea3c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (c8a7cafb-40f3-4781-b49d-4a4d79224dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f14568f8-c5ff-41ff-bf1f-4f4f6a95675d tempest-CreateVolumesFromImageTest-210590368 None] Created volume successfully. Sep 28 21:54:23 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf 1073741824" returned: 0 in 0.677s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:23 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf Sep 28 21:54:23 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (9803d545-ed0b-4891-8bab-4d021683751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563095f1-b91c-4807-ac7f-08a4cee4ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563095f1-b91c-4807-ac7f-08a4cee4ee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-663618607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cdceb7-992e-48b0-987b-37c741858eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:24Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b1fd79-b9f8-468a-b53c-b05d4fa40b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b1fd79-b9f8-468a-b53c-b05d4fa40b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e6e1b6-4910-4e03-a6a1-c71bb4ebc878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:23 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e6e1b6-4910-4e03-a6a1-c71bb4ebc878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05cdceb7-992e-48b0-987b-37c741858eba', 'volume_name': 'volume-05cdceb7-992e-48b0-987b-37c741858eba', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffe0e23-75fd-4a67-8d5c-f4e907b54543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffe0e23-75fd-4a67-8d5c-f4e907b54543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bae2e3a-e0b7-404f-80c6-5792b78fc16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume 05cdceb7-992e-48b0-987b-37c741858eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05cdceb7-992e-48b0-987b-37c741858eba', 'volume_size': 1} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:24 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf" returned: 0 in 0.337s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.519s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079289952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc0b49f-2edb-4df4-acdf-0d1fe0b8f705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:21Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Creating volume efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:24 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:24 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 1073741824 Sep 28 21:54:24 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbdceda-4cf9-4cb9-a4bc-50ade6f0185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886e4742-7820-494e-a9ef-e3e05c35e6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Volume volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf (6a409b8a-07e9-4ece-aff7-4f08e7f8eadf): created successfully Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886e4742-7820-494e-a9ef-e3e05c35e6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (01c0e83d-e305-4124-b2ba-e65c55d2f9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:24 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ad1c0cd3-9a42-4e50-a54e-bb52e78d05c7 tempest-CreateVolumesFromImageTest-210590368 None] Created volume successfully. Sep 28 21:54:24 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 1073741824" returned: 0 in 0.478s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:24 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 Sep 28 21:54:24 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Flow 'volume_create_manager' (a2c7bc85-8fb4-44ac-a0d5-0b916db5a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fb49fe-6af7-4dd4-88a5-9ed8fead5370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fb49fe-6af7-4dd4-88a5-9ed8fead5370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5340e5-459c-4f5b-a6d3-effa35dcbed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc768a434af4e4aa3d629c1d9d26e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:25Z,use_quota=True,user_id='ec908e00aee4468db7282c5497716316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e67ae166-55f7-4a34-9ac5-2d1bef45552f),volume_type_id=e67ae166-55f7-4a34-9ac5-2d1bef45552f)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea126311-08de-405f-b7a5-3fa09caa27fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea126311-08de-405f-b7a5-3fa09caa27fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a57bb76-8636-4555-a7a2-8d9a3482d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (50a675f4-8b89-4897-82c4-80a6aa0d7b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ac2008-e530-4011-9ff4-b0956549b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ac2008-e530-4011-9ff4-b0956549b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1477339421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598360a9-ef07-4fb2-8960-2c414ffe358a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:25Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bff9674-f835-4cff-b5ad-291501ebee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bff9674-f835-4cff-b5ad-291501ebee12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654e2769-36f8-4af4-8580-8b7f22115636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654e2769-36f8-4af4-8580-8b7f22115636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598360a9-ef07-4fb2-8960-2c414ffe358a', 'volume_name': 'volume-598360a9-ef07-4fb2-8960-2c414ffe358a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b2d12d-6875-41d4-84f4-72347a51636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:24 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b2d12d-6875-41d4-84f4-72347a51636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbcf7a3-54bc-4048-be71-90889eb5489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume 598360a9-ef07-4fb2-8960-2c414ffe358a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598360a9-ef07-4fb2-8960-2c414ffe358a', 'volume_size': 1} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:25 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (9f2e7958-8e9a-48f0-8984-04b3a31e0dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af04cd2a-09bb-455a-ab44-8d8b6109adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705" returned: 0 in 0.397s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.917s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1657663994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97805dc-9826-4c90-9dd9-823d93ee2a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:22Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Creating volume b97805dc-9826-4c90-9dd9-823d93ee2a61 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:25 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 1073741824 Sep 28 21:54:25 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af04cd2a-09bb-455a-ab44-8d8b6109adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2115301214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968e66ea-8303-4645-8f66-70a8d39e7d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:25Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4932c35c-1bfc-470f-a90f-d483e36d87d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4932c35c-1bfc-470f-a90f-d483e36d87d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1bd935-8705-4156-a816-5d157eeae920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1bd935-8705-4156-a816-5d157eeae920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968e66ea-8303-4645-8f66-70a8d39e7d39', 'volume_name': 'volume-968e66ea-8303-4645-8f66-70a8d39e7d39', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc67b9-8ca0-4ca8-861d-2d76350fd716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc67b9-8ca0-4ca8-861d-2d76350fd716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06199d72-94cb-4f85-b878-b514435ae32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume 968e66ea-8303-4645-8f66-70a8d39e7d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968e66ea-8303-4645-8f66-70a8d39e7d39', 'volume_size': 1} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db4d276-9a15-4ce6-b821-7d0113b4b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d2b811-305e-4ffd-a5cb-cca67b4d0053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Volume volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 (efc0b49f-2edb-4df4-acdf-0d1fe0b8f705): created successfully Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d2b811-305e-4ffd-a5cb-cca67b4d0053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (9fc93919-de59-494b-859d-c8b341198ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-dc53d288-a036-471a-8eff-c796e0a6f0c2 tempest-CreateVolumesFromImageTest-210590368 None] Created volume successfully. Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (54662bdd-ad7b-4a67-a9f9-f350eb270201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db5daea-8ac0-4103-9229-128e014e4617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db5daea-8ac0-4103-9229-128e014e4617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761411019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b535682-c89e-46a1-b508-740b013d33d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:25Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636d2953-9e0f-4fc6-8caa-a419232fe25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636d2953-9e0f-4fc6-8caa-a419232fe25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2770eb10-da68-49de-84f0-04a75f6de813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2770eb10-da68-49de-84f0-04a75f6de813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b535682-c89e-46a1-b508-740b013d33d8', 'volume_name': 'volume-4b535682-c89e-46a1-b508-740b013d33d8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4e9e99-7413-4bb0-81aa-8a721ae8b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4e9e99-7413-4bb0-81aa-8a721ae8b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeede826-cbbb-4a48-be02-0d1e3f7b778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume 4b535682-c89e-46a1-b508-740b013d33d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b535682-c89e-46a1-b508-740b013d33d8', 'volume_size': 1} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a57bb76-8636-4555-a7a2-8d9a3482d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb5340e5-459c-4f5b-a6d3-effa35dcbed1', 'volume_name': 'volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1', 'volume_size': 1, 'image_id': '5013365d-d47c-496e-b318-88d6ab4d4389', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5013365d-d47c-496e-b318-88d6ab4d4389', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e70563ae81be26ce459740a4707ed81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdc768a434af4e4aa3d629c1d9d26e0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8757d5f04aa923e5b740a645c557d2f0599c518b8270c96cce1a3755fdc59eeaea04d4b049255fb23febd126bc859a35db239cad066d872f9018f71ac1a54e0f', 'id': '5013365d-d47c-496e-b318-88d6ab4d4389', 'created_at': datetime.datetime(2026, 9, 28, 19, 54, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5013365d-d47c-496e-b318-88d6ab4d4389/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8947ea2e-1d1e-499d-bfeb-ee06e3556e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8947ea2e-1d1e-499d-bfeb-ee06e3556e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9a86ba-1df6-4e71-9442-6893e36bf111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Volume cb5340e5-459c-4f5b-a6d3-effa35dcbed1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1', 'volume_size': 1, 'image_id': '5013365d-d47c-496e-b318-88d6ab4d4389', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5013365d-d47c-496e-b318-88d6ab4d4389', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e70563ae81be26ce459740a4707ed81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdc768a434af4e4aa3d629c1d9d26e0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8757d5f04aa923e5b740a645c557d2f0599c518b8270c96cce1a3755fdc59eeaea04d4b049255fb23febd126bc859a35db239cad066d872f9018f71ac1a54e0f', 'id': '5013365d-d47c-496e-b318-88d6ab4d4389', 'created_at': datetime.datetime(2026, 9, 28, 19, 54, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5013365d-d47c-496e-b318-88d6ab4d4389/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Trying to clone cb5340e5-459c-4f5b-a6d3-effa35dcbed1 from image 5013365d-d47c-496e-b318-88d6ab4d4389 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5013365d-d47c-496e-b318-88d6ab4d4389', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Image download 0.00 MB at 0.00 MB/s Sep 28 21:54:25 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 1073741824" returned: 0 in 0.586s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35b2f81-ed0c-4fa2-b571-aef2c0cb2a96]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:25 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:25 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:25 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (7231151e-9ee1-4beb-9260-0194f4e3dbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:25 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2152919f-a6a9-4932-aa16-83ed3593cfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2152919f-a6a9-4932-aa16-83ed3593cfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-64430996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bb34af-e097-4eea-9e89-d5871d9f3fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:26Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1db4c7d-4c90-4b43-8908-c1a27967b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1db4c7d-4c90-4b43-8908-c1a27967b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadde381-6a6c-4818-8106-cfe3b9afc6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadde381-6a6c-4818-8106-cfe3b9afc6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5bb34af-e097-4eea-9e89-d5871d9f3fe7', 'volume_name': 'volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b09ec40-4a64-448f-8596-c9a058ad210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b09ec40-4a64-448f-8596-c9a058ad210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b2557f-a887-4e0c-b144-98bad990566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume c5bb34af-e097-4eea-9e89-d5871d9f3fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7', 'volume_size': 1} Sep 28 21:54:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:26 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61" returned: 0 in 0.291s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.476s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1329159141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ada383-0cd6-42ab-8e84-9569bca8358d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fc478430614245b9726c83722b2ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:22Z,use_quota=True,user_id='557d8671bc994c97b7c89282a341c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Creating volume 48ada383-0cd6-42ab-8e84-9569bca8358d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:26 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:26 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:26 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d 1073741824 Sep 28 21:54:26 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c0fc02-92d5-4044-beff-0679663fc4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97805dc-9826-4c90-9dd9-823d93ee2a61', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafafe8b-b1f4-4831-b608-5531b370b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Volume volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 (b97805dc-9826-4c90-9dd9-823d93ee2a61): created successfully Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafafe8b-b1f4-4831-b608-5531b370b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (ae256c5b-158c-41cd-8e5e-04f9ce10f852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:26 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-08465e8d-aa45-46e2-a029-f1eb191aaed8 tempest-CreateVolumesFromImageTest-210590368 None] Created volume successfully. Sep 28 21:54:26 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD Sep 28 21:54:26 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:26 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Temporary image 5013365d-d47c-496e-b318-88d6ab4d4389 is fetched for user ec908e00aee4468db7282c5497716316. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee29135-c8f1-4428-a8cc-5d4d1f35a760]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:26 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d 1073741824" returned: 0 in 0.457s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:26 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d Sep 28 21:54:26 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:26 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD Sep 28 21:54:26 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:26 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d" returned: 0 in 0.241s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.210s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7dd589-3c54-40dc-97e6-8830738249c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ada383-0cd6-42ab-8e84-9569bca8358d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76db1a12-8b45-40c4-829e-ba718b3146c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Creating offline snapshot f4a09851-a411-47df-a96c-bb602f3a9030 of volume f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:54:26 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eabfada-1bd8-4103-b646-1fe303946bb9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Volume volume-48ada383-0cd6-42ab-8e84-9569bca8358d (48ada383-0cd6-42ab-8e84-9569bca8358d): created successfully Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76db1a12-8b45-40c4-829e-ba718b3146c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Flow 'volume_create_manager' (f632d722-c469-41d6-9a1b-bef092638848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:26 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2ee5f1ea-f9c3-46e2-a62d-d3ec25129847 tempest-CreateVolumesFromImageTest-210590368 None] Created volume successfully. Sep 28 21:54:26 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD Sep 28 21:54:26 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:27 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 Sep 28 21:54:27 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-48ada383-0cd6-42ab-8e84-9569bca8358d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-48ada383-0cd6-42ab-8e84-9569bca8358d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:27 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-quobyte-48ada383-0cd6-42ab-8e84-9569bca8358d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-48ada383-0cd6-42ab-8e84-9569bca8358d" acquired by "delete_volume" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5297c0-fb7a-4dd9-86fc-ab362f57dd73]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:27 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" returned: 0 in 0.402s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:27 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 1G Sep 28 21:54:27 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:27 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d Sep 28 21:54:27 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:27 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d" returned: 0 in 0.392s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:27 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d Sep 28 21:54:27 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:27 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 1G" returned: 0 in 0.438s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:27 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 Sep 28 21:54:27 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:27 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-48ada383-0cd6-42ab-8e84-9569bca8358d" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-48ada383-0cd6-42ab-8e84-9569bca8358d" released by "delete_volume" :: held 0.697s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Created reservations ['ebb63395-eaff-4f80-992b-50d4fda8c01c', 'b3ab8a6c-f93c-4808-a47b-1ede6767b911', 'a1ee1900-393a-4c8b-9df6-7ada614ef015', 'f1c807ef-ab15-42e1-8f2a-d099f181becf'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:28 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030" returned: 0 in 0.309s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:28 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 is being set with open permissions: ugo+rw Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:28 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 Sep 28 21:54:28 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:28 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:28 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:28 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030" returned: 0 in 0.269s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-b97805dc-9826-4c90-9dd9-823d93ee2a61-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:28 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.277s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Deleted volume successfully. Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-b97805dc-9826-4c90-9dd9-823d93ee2a61-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:28 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.info Sep 28 21:54:28 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2311c671-7c63-4d69-8df4-cf0a383e8711 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-48ada383-0cd6-42ab-8e84-9569bca8358d-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-quobyte-b97805dc-9826-4c90-9dd9-823d93ee2a61" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-b97805dc-9826-4c90-9dd9-823d93ee2a61" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2709402f-02da-442b-afc7-0b5e0742efc9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:28 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 Sep 28 21:54:28 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:28 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.info" returned: 0 in 0.310s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:28 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.info is being set with open permissions: ugo+rw Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:28 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.info Sep 28 21:54:28 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:28 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61" returned: 0 in 0.367s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:28 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61 Sep 28 21:54:28 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:28 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.info" returned: 0 in 0.275s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.943s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-663618607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cdceb7-992e-48b0-987b-37c741858eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:24Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Creating volume 05cdceb7-992e-48b0-987b-37c741858eba {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:28 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:29 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba 1073741824 Sep 28 21:54:29 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-07b078b7-3ea9-4a2a-b82a-569a72f439ae tempest-CreateVolumesFromSnapshotTest-225403594 None] Create snapshot completed successfully Sep 28 21:54:29 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b97805dc-9826-4c90-9dd9-823d93ee2a61" returned: 0 in 0.273s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-b97805dc-9826-4c90-9dd9-823d93ee2a61" released by "delete_volume" :: held 0.684s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Created reservations ['065a3b50-e427-41c5-b721-4caaf7939507', 'd346d9ae-58a1-4a38-adac-dccddb76c194', 'c3c765f1-d00d-4d43-98f8-e28d2e546ce8', '53a098f6-5833-4859-ac87-e7b78ba21e71'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:29 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:29 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:29 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba 1073741824" returned: 0 in 0.452s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:29 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba Sep 28 21:54:29 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:29 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.288s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Deleted volume successfully. Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7a397096-4bee-46ea-8d15-a30b81a858a0 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-b97805dc-9826-4c90-9dd9-823d93ee2a61-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-quobyte-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbc184f-3eb7-4ea7-b5bc-25afadfe4a14]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:29 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba" returned: 0 in 0.323s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.792s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1477339421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598360a9-ef07-4fb2-8960-2c414ffe358a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:25Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Creating volume 598360a9-ef07-4fb2-8960-2c414ffe358a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:29 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bae2e3a-e0b7-404f-80c6-5792b78fc16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05cdceb7-992e-48b0-987b-37c741858eba', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:29 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 Sep 28 21:54:29 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:29 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a 1073741824 Sep 28 21:54:29 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afd0d55-c499-441e-9769-b2af288a66df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:29 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume volume-05cdceb7-992e-48b0-987b-37c741858eba (05cdceb7-992e-48b0-987b-37c741858eba): created successfully Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afd0d55-c499-441e-9769-b2af288a66df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:29 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (9803d545-ed0b-4891-8bab-4d021683751a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-121a9163-ee75-463f-a127-c521dcf42533 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created volume successfully. Sep 28 21:54:30 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705" returned: 0 in 0.416s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:30 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705 Sep 28 21:54:30 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:30 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a 1073741824" returned: 0 in 0.517s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:30 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a Sep 28 21:54:30 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:30 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705" returned: 0 in 0.309s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705" released by "delete_volume" :: held 0.782s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (5a0f1181-d081-4dfd-aea0-94d85a202967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86fd173-dfeb-454e-95bd-862980d7eadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86fd173-dfeb-454e-95bd-862980d7eadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124845199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:30Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f48ed8d-844f-4ef6-80d0-05b40e1e662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f48ed8d-844f-4ef6-80d0-05b40e1e662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21474e20-baf5-42b2-accf-834f48490a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21474e20-baf5-42b2-accf-834f48490a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1', 'volume_name': 'volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5300e55-f691-47e8-8d00-883479993ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5300e55-f691-47e8-8d00-883479993ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e82a64-5dbf-430f-b792-9fec7ec18f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume 28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1', 'volume_size': 1} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Created reservations ['14525097-be51-48ac-8c73-c6cc61dff1f0', '4c069b77-b7a6-44c3-8b16-c39be299ac80', '96a255db-6657-4caf-9d61-dcecf66a57fd', '1ed5492a-1090-4a6e-842b-52f61d458b52'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:30 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a" returned: 0 in 0.320s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.549s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2115301214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968e66ea-8303-4645-8f66-70a8d39e7d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:25Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Creating volume 968e66ea-8303-4645-8f66-70a8d39e7d39 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:30 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:30 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 1073741824 Sep 28 21:54:30 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbcf7a3-54bc-4048-be71-90889eb5489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598360a9-ef07-4fb2-8960-2c414ffe358a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574e3d34-289a-43c2-894b-15fcf97d4104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume volume-598360a9-ef07-4fb2-8960-2c414ffe358a (598360a9-ef07-4fb2-8960-2c414ffe358a): created successfully Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574e3d34-289a-43c2-894b-15fcf97d4104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (50a675f4-8b89-4897-82c4-80a6aa0d7b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ee66f746-4e26-4b04-9a3e-180ce50f3a10 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created volume successfully. Sep 28 21:54:30 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:30 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-quobyte-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf" acquired by "delete_volume" :: waited 0.036s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f773b9-1fb2-4a8c-9c17-426eaafbc11e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (69e1a39c-1b3b-4f10-aacc-dc786563f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6d7b48-80db-4aee-9b6e-3eb56527649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6d7b48-80db-4aee-9b6e-3eb56527649b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064893369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c74423-f731-4897-9c97-06f3bc7043d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:31Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021b5935-4d62-4e16-8e7c-c3453196a4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021b5935-4d62-4e16-8e7c-c3453196a4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cad552-739a-456c-831b-2555968ab055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cad552-739a-456c-831b-2555968ab055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c74423-f731-4897-9c97-06f3bc7043d7', 'volume_name': 'volume-16c74423-f731-4897-9c97-06f3bc7043d7', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dfa460-d838-47ff-ab41-43fb3368e0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dfa460-d838-47ff-ab41-43fb3368e0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79aa19a-7816-4bd3-b0b4-9698ac224680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume 16c74423-f731-4897-9c97-06f3bc7043d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c74423-f731-4897-9c97-06f3bc7043d7', 'volume_size': 1} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:31 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf Sep 28 21:54:31 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.436s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Deleted volume successfully. Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-615eb2b4-6e09-4ed8-b0e5-f3e51595c242 tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-efc0b49f-2edb-4df4-acdf-0d1fe0b8f705-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:31 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 1073741824" returned: 0 in 0.662s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:31 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 Sep 28 21:54:31 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:31 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (f3993e53-91d7-474c-858b-ae89b217a066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739211f0-dd04-4bff-b7a3-cd19ea0119dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf" returned: 0 in 0.518s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:31 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739211f0-dd04-4bff-b7a3-cd19ea0119dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556195111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d302cf-96b3-41b8-9b6f-bcde5a425bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:31Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb39731-8b9d-4f37-a931-fb99dd302d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb39731-8b9d-4f37-a931-fb99dd302d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f89699c-c6b6-4a6e-933b-a2e0b6ade513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f89699c-c6b6-4a6e-933b-a2e0b6ade513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d302cf-96b3-41b8-9b6f-bcde5a425bfa', 'volume_name': 'volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d599fd-1bd6-4b4d-96c3-fe15443866f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d599fd-1bd6-4b4d-96c3-fe15443866f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a5d916-ae59-45e8-9850-b1bfbd9bb5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume 78d302cf-96b3-41b8-9b6f-bcde5a425bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa', 'volume_size': 1} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:31 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39" returned: 0 in 0.411s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.417s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761411019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b535682-c89e-46a1-b508-740b013d33d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:25Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Creating volume 4b535682-c89e-46a1-b508-740b013d33d8 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:31 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06199d72-94cb-4f85-b878-b514435ae32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968e66ea-8303-4645-8f66-70a8d39e7d39', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 1073741824 Sep 28 21:54:31 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481fd363-1465-416b-aaea-2ad691114532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:31 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf" returned: 0 in 0.325s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume volume-968e66ea-8303-4645-8f66-70a8d39e7d39 (968e66ea-8303-4645-8f66-70a8d39e7d39): created successfully Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481fd363-1465-416b-aaea-2ad691114532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (9f2e7958-8e9a-48f0-8984-04b3a31e0dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf" released by "delete_volume" :: held 0.940s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5851444a-a120-4052-a0f2-c706796df070 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created volume successfully. Sep 28 21:54:31 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (e2b82c53-f2a5-4cd4-845c-cfe5331885d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b70993-692b-499a-9414-4000c3d36b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b70993-692b-499a-9414-4000c3d36b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1634838942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f5aa8a-8173-4688-bb20-c0be7418ff04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:32Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2284434b-4c6c-47cc-b943-1b4ec3ad0dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2284434b-4c6c-47cc-b943-1b4ec3ad0dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c37005-13ab-4a2e-90c7-f5e37558c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c37005-13ab-4a2e-90c7-f5e37558c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f5aa8a-8173-4688-bb20-c0be7418ff04', 'volume_name': 'volume-05f5aa8a-8173-4688-bb20-c0be7418ff04', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b119bcd3-cb42-4d89-8742-13b07d78f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b119bcd3-cb42-4d89-8742-13b07d78f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b630c78-fd08-48d0-a049-736f015d5617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume 05f5aa8a-8173-4688-bb20-c0be7418ff04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f5aa8a-8173-4688-bb20-c0be7418ff04', 'volume_size': 1} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Created reservations ['2da42aa4-74fc-425e-a859-d1c5e249d2a3', '855f77d7-a945-49b2-b90f-5a278135b29c', 'c5e0846a-90c9-4761-aee8-8f89b8f84642', 'f2a702e7-96a2-4750-a2ca-877ee48eeb26'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:32 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:32 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (d516b8f1-b92a-48f2-b995-652cda7dc075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:32 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a5927b-8958-4301-841c-abdedab13ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 1073741824" returned: 0 in 0.619s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a5927b-8958-4301-841c-abdedab13ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1155487673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7640c5e6-1444-40dd-a3c6-5ac2e881e35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:32Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad93b425-6bf7-4dca-b1c8-768707bb4bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad93b425-6bf7-4dca-b1c8-768707bb4bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27579e6b-27c8-47e9-810f-5e4ee68f8d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27579e6b-27c8-47e9-810f-5e4ee68f8d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7640c5e6-1444-40dd-a3c6-5ac2e881e35d', 'volume_name': 'volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68b724c-39f5-4d10-b7e6-59a1158b1f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68b724c-39f5-4d10-b7e6-59a1158b1f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fe8443-1910-48b2-995c-b83245ff93b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume 7640c5e6-1444-40dd-a3c6-5ac2e881e35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d', 'volume_size': 1} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:32 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.317s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Deleted volume successfully. Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-cd2c7f0a-c6e8-4116-86e7-27f5237bf36c tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-6a409b8a-07e9-4ece-aff7-4f08e7f8eadf-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:32 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 Sep 28 21:54:32 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:32 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8" returned: 0 in 0.247s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.906s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-64430996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bb34af-e097-4eea-9e89-d5871d9f3fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c580dc9e63f74eabba6213991c0bfe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:26Z,use_quota=True,user_id='1231db3e4998467da4720844bd0c0b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Creating volume c5bb34af-e097-4eea-9e89-d5871d9f3fe7 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:32 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeede826-cbbb-4a48-be02-0d1e3f7b778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b535682-c89e-46a1-b508-740b013d33d8', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 1073741824 Sep 28 21:54:32 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dfa689-c6db-4921-b0ca-32badcaad7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume volume-4b535682-c89e-46a1-b508-740b013d33d8 (4b535682-c89e-46a1-b508-740b013d33d8): created successfully Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dfa689-c6db-4921-b0ca-32badcaad7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (54662bdd-ad7b-4a67-a9f9-f350eb270201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f7828019-4712-4a3d-9a0f-6cd474203e54 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created volume successfully. Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-163f88eb-a308-40c0-892e-5271d38a8b73-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:33 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 1073741824" returned: 0 in 0.426s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-163f88eb-a308-40c0-892e-5271d38a8b73-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "cinder-quobyte-163f88eb-a308-40c0-892e-5271d38a8b73" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:33 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 Sep 28 21:54:33 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-163f88eb-a308-40c0-892e-5271d38a8b73" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[45caa6b6-9ee6-45d1-80ae-4fe0e16339b7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:33 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 Sep 28 21:54:33 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:33 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.337s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5340e5-459c-4f5b-a6d3-effa35dcbed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc768a434af4e4aa3d629c1d9d26e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:25Z,use_quota=True,user_id='ec908e00aee4468db7282c5497716316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e67ae166-55f7-4a34-9ac5-2d1bef45552f),volume_type_id=e67ae166-55f7-4a34-9ac5-2d1bef45552f)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Creating volume cb5340e5-459c-4f5b-a6d3-effa35dcbed1 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:33 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:33 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 1073741824 Sep 28 21:54:33 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b2557f-a887-4e0c-b144-98bad990566b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd0b866-95d7-47e6-94f4-00076e8579af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Volume volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 (c5bb34af-e097-4eea-9e89-d5871d9f3fe7): created successfully Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd0b866-95d7-47e6-94f4-00076e8579af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Flow 'volume_create_manager' (7231151e-9ee1-4beb-9260-0194f4e3dbcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:33 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-abc3804e-c0fe-4693-9afa-0f023afdac65 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created volume successfully. Sep 28 21:54:33 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73" returned: 0 in 0.377s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:33 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73 Sep 28 21:54:33 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:33 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-163f88eb-a308-40c0-892e-5271d38a8b73" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-quobyte-163f88eb-a308-40c0-892e-5271d38a8b73" released by "delete_volume" :: held 0.682s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:34 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 1073741824" returned: 0 in 0.483s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Created reservations ['684dca1c-0750-4e97-9780-126fbc761e6f', '64456780-d647-438c-bc93-8b97d2c9dcc9', 'c45976eb-580f-4837-8107-7510567ef89e', '145a941b-0b7e-4998-9a96-2c802175367d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:34 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 Sep 28 21:54:34 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:34 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:34 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:34 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1" returned: 0 in 0.255s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.723s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124845199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:30Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Creating volume 28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:34 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:34 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.261s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:34 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 1073741824 Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:34 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Deleted volume successfully. Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Attempting download of 5013365d-d47c-496e-b318-88d6ab4d4389 ((None, [{'url': 'file:///opt/stack/data/glance/images/5013365d-d47c-496e-b318-88d6ab4d4389', 'metadata': {}}])) to volume cb5340e5-459c-4f5b-a6d3-effa35dcbed1. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-038a8086-3b2b-4bb5-9f9d-4696644dbadf tempest-CreateVolumesFromImageTest-210590368 None] Lock "cinder-163f88eb-a308-40c0-892e-5271d38a8b73-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[221c788c-0cf6-4942-b8ce-f8a21156a447]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5013365d-d47c-496e-b318-88d6ab4d4389_6bu7m3ty {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:34 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5013365d-d47c-496e-b318-88d6ab4d4389_6bu7m3ty Sep 28 21:54:34 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-c5bb34af-e097-4eea-9e89-d5871d9f3fe7-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-c5bb34af-e097-4eea-9e89-d5871d9f3fe7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-quobyte-c5bb34af-e097-4eea-9e89-d5871d9f3fe7" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-c5bb34af-e097-4eea-9e89-d5871d9f3fe7" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e02d1d-ad39-4462-9149-428268c1a9ff]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:34 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5013365d-d47c-496e-b318-88d6ab4d4389_6bu7m3ty" returned: 0 in 0.480s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5013365d-d47c-496e-b318-88d6ab4d4389_6bu7m3ty {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:35 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 Sep 28 21:54:35 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:35 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 1073741824" returned: 0 in 0.667s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:35 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5013365d-d47c-496e-b318-88d6ab4d4389_6bu7m3ty Sep 28 21:54:35 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:35 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 Sep 28 21:54:35 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:35 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7" returned: 0 in 0.471s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:35 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7 Sep 28 21:54:35 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:35 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:35 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5013365d-d47c-496e-b318-88d6ab4d4389_6bu7m3ty" returned: 1 in 0.422s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5013365d-d47c-496e-b318-88d6ab4d4389_6bu7m3ty' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1" returned: 0 in 0.326s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d6a249-94dd-472d-a830-b93ba7e88b98]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.142s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064893369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c74423-f731-4897-9c97-06f3bc7043d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:31Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Creating volume 16c74423-f731-4897-9c97-06f3bc7043d7 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:35 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e82a64-5dbf-430f-b792-9fec7ec18f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cc7346-4b15-4d8f-9521-406859b8e71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:35 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 1073741824 Sep 28 21:54:35 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:35 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 (28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1): created successfully Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cc7346-4b15-4d8f-9521-406859b8e71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (5a0f1181-d081-4dfd-aea0-94d85a202967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-43d9f487-7a13-447c-8195-4e35443a1251 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created volume successfully. Sep 28 21:54:35 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD Sep 28 21:54:35 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:35 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c5bb34af-e097-4eea-9e89-d5871d9f3fe7" returned: 0 in 0.341s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-c5bb34af-e097-4eea-9e89-d5871d9f3fe7" released by "delete_volume" :: held 0.872s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created reservations ['a8c1a06d-ad44-46d3-9ab6-5b542159d1fb', 'bc5aad27-fbea-473f-83a6-9ed91af6fa02', 'cdc99d00-d099-40e8-971d-4b0d93e2e9aa', '38714b0f-f5f6-4767-8f24-069f0b888aac'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:35 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:35 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:35 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-4b535682-c89e-46a1-b508-740b013d33d8-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-4b535682-c89e-46a1-b508-740b013d33d8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:36 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD Sep 28 21:54:36 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:36 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 1073741824" returned: 0 in 0.723s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-quobyte-4b535682-c89e-46a1-b508-740b013d33d8" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-4b535682-c89e-46a1-b508-740b013d33d8" acquired by "delete_volume" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[79568171-33e4-4813-a74b-a1af6c5d9c81]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:36 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 Sep 28 21:54:36 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:36 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.478s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:36 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:36 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Deleted volume successfully. Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] 5013365d-d47c-496e-b318-88d6ab4d4389 was raw, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:36 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 Sep 28 21:54:36 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8d7e9eb1-94b7-4290-bf62-b9521027b43b tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-c5bb34af-e097-4eea-9e89-d5871d9f3fe7-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:36 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 Sep 28 21:54:36 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:36 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7" returned: 0 in 0.306s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.814s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556195111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d302cf-96b3-41b8-9b6f-bcde5a425bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:31Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Creating volume 78d302cf-96b3-41b8-9b6f-bcde5a425bfa {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:36 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:36 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa 1073741824 Sep 28 21:54:36 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79aa19a-7816-4bd3-b0b4-9698ac224680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c74423-f731-4897-9c97-06f3bc7043d7', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4eab03-f489-43cf-adf6-376604339668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:36 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume volume-16c74423-f731-4897-9c97-06f3bc7043d7 (16c74423-f731-4897-9c97-06f3bc7043d7): created successfully Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4eab03-f489-43cf-adf6-376604339668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (69e1a39c-1b3b-4f10-aacc-dc786563f58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:36 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d2458509-9f69-43db-af6c-49edf94be38a tempest-CreateVolumesFromSnapshotTest-225403594 None] Created volume successfully. Sep 28 21:54:36 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8" returned: 0 in 0.528s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:36 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8 Sep 28 21:54:36 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:37 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1" returned: 0 in 0.635s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5013365d-d47c-496e-b318-88d6ab4d4389_uqj7_ymldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:54:37 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:37 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 1G Sep 28 21:54:37 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:37 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa 1073741824" returned: 0 in 0.529s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:37 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-4b535682-c89e-46a1-b508-740b013d33d8" returned: 0 in 0.365s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-4b535682-c89e-46a1-b508-740b013d33d8" released by "delete_volume" :: held 0.993s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:37 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa Sep 28 21:54:37 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created reservations ['bada2ac4-29d3-4698-8800-1f9a26ce824b', '282d8c63-3bbe-428b-8ac0-88c85be70ce7', '8981b22c-9acd-4fbc-a3a6-b0ae8185cef5', '502e5f68-eeff-40c6-a3b6-b734022e07f1'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:37 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:37 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:37 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 1G" returned: 0 in 0.407s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Downloaded image 5013365d-d47c-496e-b318-88d6ab4d4389 ((None, [{'url': 'file:///opt/stack/data/glance/images/5013365d-d47c-496e-b318-88d6ab4d4389', 'metadata': {}}])) to volume cb5340e5-459c-4f5b-a6d3-effa35dcbed1 successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Temporary image 5013365d-d47c-496e-b318-88d6ab4d4389 for user ec908e00aee4468db7282c5497716316 is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Marking volume cb5340e5-459c-4f5b-a6d3-effa35dcbed1 as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Copying metadata from image 5013365d-d47c-496e-b318-88d6ab4d4389 to cb5340e5-459c-4f5b-a6d3-effa35dcbed1. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Creating volume glance metadata for volume cb5340e5-459c-4f5b-a6d3-effa35dcbed1 backed by image 5013365d-d47c-496e-b318-88d6ab4d4389 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5013365d-d47c-496e-b318-88d6ab4d4389', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5e70563ae81be26ce459740a4707ed81', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:54:37 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa" returned: 0 in 0.343s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.415s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1634838942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f5aa8a-8173-4688-bb20-c0be7418ff04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:32Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Creating volume 05f5aa8a-8173-4688-bb20-c0be7418ff04 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:37 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a5d916-ae59-45e8-9850-b1bfbd9bb5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:37 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 1073741824 Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f2ba55-ef73-42cd-acf4-f044ce52782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:37 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:37 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa (78d302cf-96b3-41b8-9b6f-bcde5a425bfa): created successfully Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f2ba55-ef73-42cd-acf4-f044ce52782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (f3993e53-91d7-474c-858b-ae89b217a066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9a86ba-1df6-4e71-9442-6893e36bf111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1', 'volume_size': 1, 'image_id': '5013365d-d47c-496e-b318-88d6ab4d4389', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5013365d-d47c-496e-b318-88d6ab4d4389', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e70563ae81be26ce459740a4707ed81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdc768a434af4e4aa3d629c1d9d26e0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8757d5f04aa923e5b740a645c557d2f0599c518b8270c96cce1a3755fdc59eeaea04d4b049255fb23febd126bc859a35db239cad066d872f9018f71ac1a54e0f', 'id': '5013365d-d47c-496e-b318-88d6ab4d4389', 'created_at': datetime.datetime(2026, 9, 28, 19, 54, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5013365d-d47c-496e-b318-88d6ab4d4389/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb26c73f-a267-4795-92ab-69925b21f50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-4f788858-eaa9-4c67-9ce9-6ae5c76b8a01 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created volume successfully. Sep 28 21:54:37 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Volume volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 (cb5340e5-459c-4f5b-a6d3-effa35dcbed1): created successfully Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb26c73f-a267-4795-92ab-69925b21f50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:37 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Flow 'volume_create_manager' (a2c7bc85-8fb4-44ac-a0d5-0b916db5a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Deleted volume successfully. Sep 28 21:54:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-04de0133-688c-42e2-bb73-5e31bddca594 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Created volume successfully. Sep 28 21:54:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172a0a4-acb6-4e74-bb6e-3f4337299503 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-4b535682-c89e-46a1-b508-740b013d33d8-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:38 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 1073741824" returned: 0 in 0.540s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:38 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 Sep 28 21:54:38 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-968e66ea-8303-4645-8f66-70a8d39e7d39-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-968e66ea-8303-4645-8f66-70a8d39e7d39-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Acquiring lock "cinder-cb5340e5-459c-4f5b-a6d3-effa35dcbed1-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-quobyte-968e66ea-8303-4645-8f66-70a8d39e7d39" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "cinder-cb5340e5-459c-4f5b-a6d3-effa35dcbed1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-968e66ea-8303-4645-8f66-70a8d39e7d39" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:38 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04" returned: 0 in 0.376s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.949s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1155487673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7640c5e6-1444-40dd-a3c6-5ac2e881e35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238d0d16fc4412897951d27adc8df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:32Z,use_quota=True,user_id='c61787fce4f142e68ceaf6f6feeb1bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Creating volume 7640c5e6-1444-40dd-a3c6-5ac2e881e35d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:38 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78e273c-f43a-4434-a594-f006e6cc7a21]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:38 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d 1073741824 Sep 28 21:54:38 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b630c78-fd08-48d0-a049-736f015d5617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f5aa8a-8173-4688-bb20-c0be7418ff04', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b51b0da-774f-42e9-8b92-edc60885a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Acquiring lock "cinder-quobyte-cb5340e5-459c-4f5b-a6d3-effa35dcbed1" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:38 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 (05f5aa8a-8173-4688-bb20-c0be7418ff04): created successfully Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b51b0da-774f-42e9-8b92-edc60885a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (e2b82c53-f2a5-4cd4-845c-cfe5331885d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "cinder-quobyte-cb5340e5-459c-4f5b-a6d3-effa35dcbed1" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-99a436a6-ce61-4a95-a711-737594bb91c3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created volume successfully. Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fce66f-1041-43a8-8b72-322fff28a9ab]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:38 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 Sep 28 21:54:38 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:38 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 Sep 28 21:54:38 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:38 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d 1073741824" returned: 0 in 0.502s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:39 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:39 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d Sep 28 21:54:39 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39" returned: 0 in 0.557s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:39 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:39 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39 Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1" returned: 0 in 0.470s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:39 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:39 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1 Sep 28 21:54:39 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:39 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d" returned: 0 in 0.284s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fe8443-1910-48b2-995c-b83245ff93b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badfae28-b398-4493-b337-c87a7280d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:39 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Volume volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d (7640c5e6-1444-40dd-a3c6-5ac2e881e35d): created successfully Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badfae28-b398-4493-b337-c87a7280d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Flow 'volume_create_manager' (d516b8f1-b92a-48f2-b995-652cda7dc075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5d84cdf3-9c1c-49c5-8950-852172512b56 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created volume successfully. Sep 28 21:54:39 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-968e66ea-8303-4645-8f66-70a8d39e7d39" returned: 0 in 0.322s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:39 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-cb5340e5-459c-4f5b-a6d3-effa35dcbed1" returned: 0 in 0.301s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-968e66ea-8303-4645-8f66-70a8d39e7d39" released by "delete_volume" :: held 0.967s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "cinder-quobyte-cb5340e5-459c-4f5b-a6d3-effa35dcbed1" released by "delete_volume" :: held 0.832s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Created reservations ['225162c7-78a7-4f57-90ff-6a2fe829a5d1', '88b00a40-a17b-4e56-894f-7eecf216a4dc', '633dca4d-a9f7-4ad5-aeef-3bc1e4c02fc3', 'a80da47b-c375-403d-9bc8-b9c0fc03ad98'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created reservations ['4e22b0b0-7020-4445-aa16-69fef954688f', 'b224325d-a89b-492f-b16e-3ddecd9d501c', '81bc5864-ecf1-49ac-bbdb-4d147b423c2b', 'bf147aa3-4e16-4648-91a5-28b86a5b7abe'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:39 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:39 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:39 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:39 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:39 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.291s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Deleted volume successfully. Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5e7f3eba-6eb1-4f85-8b76-a08913f12793 tempest-VolumeAndVolumeTypeFromImageTest-1290440600 None] Lock "cinder-cb5340e5-459c-4f5b-a6d3-effa35dcbed1-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:39 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.282s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Deleted volume successfully. Sep 28 21:54:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-8b566f27-5987-4d91-adfc-bad23e0fd759 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-968e66ea-8303-4645-8f66-70a8d39e7d39-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-7640c5e6-1444-40dd-a3c6-5ac2e881e35d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-7640c5e6-1444-40dd-a3c6-5ac2e881e35d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-quobyte-7640c5e6-1444-40dd-a3c6-5ac2e881e35d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-7640c5e6-1444-40dd-a3c6-5ac2e881e35d" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d020594-0386-4011-a697-8554f95118bf]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:40 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d Sep 28 21:54:40 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-598360a9-ef07-4fb2-8960-2c414ffe358a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-598360a9-ef07-4fb2-8960-2c414ffe358a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-quobyte-598360a9-ef07-4fb2-8960-2c414ffe358a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-598360a9-ef07-4fb2-8960-2c414ffe358a" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5865485-6992-49cc-8e5e-e2c808474174]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:40 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d" returned: 0 in 0.498s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:40 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d Sep 28 21:54:40 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:40 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a Sep 28 21:54:40 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:41 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7640c5e6-1444-40dd-a3c6-5ac2e881e35d" returned: 0 in 0.330s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-7640c5e6-1444-40dd-a3c6-5ac2e881e35d" released by "delete_volume" :: held 0.890s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Created reservations ['b9691d77-3ec5-492f-bfd1-8525d27c09dc', 'd7acacc8-dcd4-40eb-8f75-548f9ca6c0b7', 'fe03cf30-2230-4746-a082-7f18fdd26075', '5a9da1e4-644d-4950-b082-8c18453d9677'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:41 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a" returned: 0 in 0.558s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:41 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a Sep 28 21:54:41 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-05f5aa8a-8173-4688-bb20-c0be7418ff04-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:41 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:41 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-05f5aa8a-8173-4688-bb20-c0be7418ff04-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-quobyte-05f5aa8a-8173-4688-bb20-c0be7418ff04" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-05f5aa8a-8173-4688-bb20-c0be7418ff04" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7a9271-d3f0-4500-b98f-6a54d50bcd15]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:41 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-598360a9-ef07-4fb2-8960-2c414ffe358a" returned: 0 in 0.418s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-598360a9-ef07-4fb2-8960-2c414ffe358a" released by "delete_volume" :: held 1.055s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:41 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 Sep 28 21:54:41 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:41 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.423s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:41 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Deleted volume successfully. Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created reservations ['20336d21-468b-4b2c-aa87-2668462b343a', '00a72257-0af3-4139-91e3-84ced7d4b623', '27f49b48-3a4f-4638-ab01-c1d696127bce', '3a9ee58a-d7f5-4c9f-b1fe-74bec9475b34'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3172ac4e-f864-44b5-86a7-3236341aad1f tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-7640c5e6-1444-40dd-a3c6-5ac2e881e35d-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:42 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:42 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:42 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04" returned: 0 in 0.488s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:42 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04 Sep 28 21:54:42 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:42 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.289s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Deleted volume successfully. Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2ec88e70-b49a-4d64-9273-1318e8743c71 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-598360a9-ef07-4fb2-8960-2c414ffe358a-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:42 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05f5aa8a-8173-4688-bb20-c0be7418ff04" returned: 0 in 0.291s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-05f5aa8a-8173-4688-bb20-c0be7418ff04" released by "delete_volume" :: held 0.850s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Created reservations ['1c6cf650-3003-411d-a4af-dd7188250b99', 'cd41f874-8d39-4c4e-9b2e-dc1323069b9d', '270e53ac-daaa-493c-a291-b81c0a8779a8', '44a4ed2d-8b08-437f-bb6c-965b1b462628'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:42 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-78d302cf-96b3-41b8-9b6f-bcde5a425bfa-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-78d302cf-96b3-41b8-9b6f-bcde5a425bfa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:42 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-quobyte-78d302cf-96b3-41b8-9b6f-bcde5a425bfa" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-78d302cf-96b3-41b8-9b6f-bcde5a425bfa" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:42 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.357s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:42 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Deleted volume successfully. Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[150d41e1-eb0e-4a2b-ace9-3ac53d613dcd]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-05cdceb7-992e-48b0-987b-37c741858eba-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7df303bd-2580-4d74-ba19-aeb26911d5df tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-05f5aa8a-8173-4688-bb20-c0be7418ff04-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-05cdceb7-992e-48b0-987b-37c741858eba-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-quobyte-05cdceb7-992e-48b0-987b-37c741858eba" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-05cdceb7-992e-48b0-987b-37c741858eba" acquired by "delete_volume" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:43 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa Sep 28 21:54:43 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdcb550-0a48-492e-95a2-b0271a7dba8c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:43 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba Sep 28 21:54:43 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:43 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa" returned: 0 in 0.540s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:43 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa Sep 28 21:54:43 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:43 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba" returned: 0 in 0.489s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:43 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba Sep 28 21:54:43 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:43 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-78d302cf-96b3-41b8-9b6f-bcde5a425bfa" returned: 0 in 0.323s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-78d302cf-96b3-41b8-9b6f-bcde5a425bfa" released by "delete_volume" :: held 0.983s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:43 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created reservations ['2d980e9e-6b80-4769-8924-4fbb2cfdc7cc', '623988c5-4a37-4110-a8f7-eae6e7c46b5b', '69bbe4f5-8da9-4ab2-8458-2899608ae5a3', '3bfb1933-6a80-4e08-b77a-cd615020d79b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:44 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-05cdceb7-992e-48b0-987b-37c741858eba" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-05cdceb7-992e-48b0-987b-37c741858eba" released by "delete_volume" :: held 0.937s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:44 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:44 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created reservations ['95c6b065-8f04-49e0-80a0-cb639d83993d', 'cf99d730-3a91-4727-9588-c0d553f3beeb', '40bbb17f-0354-4cf4-a2b5-07df60a21914', 'fa97a1a4-d796-45f5-b51a-39a2a535b625'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:44 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.276s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:44 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Deleted volume successfully. Sep 28 21:54:44 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:44 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b04069fd-8012-46c2-9732-d579c66af9d6 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-78d302cf-96b3-41b8-9b6f-bcde5a425bfa-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:44 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.301s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:44 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Deleted volume successfully. Sep 28 21:54:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ec2600c-c83e-47d1-93eb-6617688fbaf5 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-05cdceb7-992e-48b0-987b-37c741858eba-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-16c74423-f731-4897-9c97-06f3bc7043d7-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-16c74423-f731-4897-9c97-06f3bc7043d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-quobyte-16c74423-f731-4897-9c97-06f3bc7043d7" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-16c74423-f731-4897-9c97-06f3bc7043d7" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb571c7d-f1e9-42b8-9ac4-868ece70814d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:45 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 Sep 28 21:54:45 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-bef38045-fecd-4d5e-ab73-60c9b2068c11-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-bef38045-fecd-4d5e-ab73-60c9b2068c11-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "cinder-quobyte-bef38045-fecd-4d5e-ab73-60c9b2068c11" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-bef38045-fecd-4d5e-ab73-60c9b2068c11" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170d8c1-ec15-4b87-872f-339f851eadca]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:45 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7" returned: 0 in 0.436s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:45 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7 Sep 28 21:54:45 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:45 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 Sep 28 21:54:45 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:45 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-16c74423-f731-4897-9c97-06f3bc7043d7" returned: 0 in 0.293s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-16c74423-f731-4897-9c97-06f3bc7043d7" released by "delete_volume" :: held 0.789s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:45 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created reservations ['1b3c44b5-e0e5-4e6a-a5c4-9b6fe2284042', 'bf4cee53-bfbf-4300-b83d-db7304ef5c95', '6f88dec8-904a-468c-ae3d-d4425ed93d42', '5f9c5dd6-2d6d-4465-b244-075bbca19235'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:46 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11" returned: 0 in 0.506s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:46 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11 Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:46 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:46 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:46 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:46 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:46 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.335s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-bef38045-fecd-4d5e-ab73-60c9b2068c11" returned: 0 in 0.388s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Deleted volume successfully. Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-quobyte-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-quobyte-bef38045-fecd-4d5e-ab73-60c9b2068c11" released by "delete_volume" :: held 0.967s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a57545f3-b8d8-4f61-bd46-3937bc9dd4a7 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-16c74423-f731-4897-9c97-06f3bc7043d7-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad18ecf8-2a2d-42ae-940e-897d421d8aba]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Created reservations ['0bd7b4db-5c05-4da3-b0ae-3313c6ad0b26', 'd79ecfe8-14f7-4bac-81ee-755f76acee84', '74e8b8bd-f954-414c-b171-772a8912e29c', '48a42df2-33e2-484d-afdc-591e485f7fe2'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:46 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 Sep 28 21:54:46 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:46 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:46 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:46 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1" returned: 0 in 0.440s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:47 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.270s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Deleted volume successfully. Sep 28 21:54:47 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1 Sep 28 21:54:47 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ec68313a-a0d3-4f48-b42d-69185ca7b676 tempest-CreateVolumesFromSourceVolumeTest-247831866 None] Lock "cinder-bef38045-fecd-4d5e-ab73-60c9b2068c11-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:47 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1" returned: 0 in 0.287s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1" released by "delete_volume" :: held 0.791s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created reservations ['6d7debd0-69a8-4a10-844e-5839d0526bfb', 'c9a324a5-b9e5-46cf-80b3-d550fc943435', '43fe70e3-3b0e-4bc6-b2ef-a8a08ae06743', '7abfddab-ec20-4e85-ba02-2fedbac9455f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:47 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:47 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-f4a09851-a411-47df-a96c-bb602f3a9030-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-f4a09851-a411-47df-a96c-bb602f3a9030-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-quobyte-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-quobyte-f4a09851-a411-47df-a96c-bb602f3a9030" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-f4a09851-a411-47df-a96c-bb602f3a9030" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Deleting offline snapshot f4a09851-a411-47df-a96c-bb602f3a9030 of volume f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] snapshot_file for this snap is: volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:54:47 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[658f4be2-76c7-4e31-910b-439e4f85899e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Deleted volume successfully. Sep 28 21:54:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-38000fcb-0df2-41da-8411-280c1c576da3 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-28a02c3c-55c0-4f4f-ac3f-4a3f751b5ea1-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:47 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 Sep 28 21:54:47 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:48 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030" returned: 0 in 0.467s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:54:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61c40ca-e241-4ed9-a5a2-e92933749638]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:48 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 Sep 28 21:54:48 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:48 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" returned: 0 in 0.517s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:48 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 Sep 28 21:54:48 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:49 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030" returned: 0 in 0.443s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:49 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030 Sep 28 21:54:49 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:49 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2.f4a09851-a411-47df-a96c-bb602f3a9030" returned: 0 in 0.304s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-f4a09851-a411-47df-a96c-bb602f3a9030" released by "_delete_snapshot" :: held 1.908s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" released by "delete_snapshot" :: held 1.948s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created reservations ['a530b012-2878-42b8-8e71-2bbae73b0c5a', '7decadfe-56b8-4eb2-a0ce-850a0b2207b2', 'e04e4eee-49d3-4ac3-9306-92b4ed4bd97d', '751a1ad3-92e6-49fd-9a1e-39eb5792930b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:49 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Delete snapshot completed successfully. Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-43e38664-9357-46f5-bbd1-2b4a89923261 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-f4a09851-a411-47df-a96c-bb602f3a9030-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Flow 'volume_create_manager' (736c7076-c199-4222-a984-a7cecdb34c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078348bf-9e0d-41d0-bd3e-d943e798f8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078348bf-9e0d-41d0-bd3e-d943e798f8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe4694b-22f3-4b0b-8051-9d9f9d96b824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07f52e2625e4aae9ca0909dbca79734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:50Z,use_quota=True,user_id='7d3750a970fa4d4f99aa3e74513ee5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12c7775-124a-4af0-98a4-85200f409d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:49 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12c7775-124a-4af0-98a4-85200f409d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4a4dea-d042-4da9-8dec-65e4a0ccc262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.image.glance [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Creating Keystone auth plugin from conf {{(pid=86489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4a4dea-d042-4da9-8dec-65e4a0ccc262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0fe4694b-22f3-4b0b-8051-9d9f9d96b824', 'volume_name': 'volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824', 'volume_size': 1, 'image_id': '2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21356b1a718e908ab335a5a5729d9136', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b07f52e2625e4aae9ca0909dbca79734', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c98c56a071fcadc0d225fe1633704134d7d7ddaf85e235fdec0541118041b0652a973e8398660d7424999bf2de8e1143c0868ad5c6df901dd6d7980aaf957d8c', 'id': '2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'created_at': datetime.datetime(2026, 9, 28, 19, 54, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b/file', 'properties': {}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065d2337-2ef7-4669-b10f-b339cfefa398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065d2337-2ef7-4669-b10f-b339cfefa398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5676426-a4c2-4c10-8f8a-399b2cff9a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:50 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Volume 0fe4694b-22f3-4b0b-8051-9d9f9d96b824: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824', 'volume_size': 1, 'image_id': '2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21356b1a718e908ab335a5a5729d9136', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b07f52e2625e4aae9ca0909dbca79734', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c98c56a071fcadc0d225fe1633704134d7d7ddaf85e235fdec0541118041b0652a973e8398660d7424999bf2de8e1143c0868ad5c6df901dd6d7980aaf957d8c', 'id': '2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'created_at': datetime.datetime(2026, 9, 28, 19, 54, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b/file', 'properties': {}}, 'image_service': } Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Trying to clone 0fe4694b-22f3-4b0b-8051-9d9f9d96b824 from image 2dcfada8-11df-4d4a-998b-e3ca04a9236b at location (None, [{'url': 'file:///opt/stack/data/glance/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'metadata': {}}]). {{(pid=86489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 21:54:50 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Image download 0.00 MB at 0.00 MB/s Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28c8f8a-05bb-40c8-afa1-33b62338de03]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "cinder-quobyte-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:50 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD Sep 28 21:54:50 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[440bef73-4d6f-4c62-9ad2-35455a2f0c38]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:51 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 Sep 28 21:54:51 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:51 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:51 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD Sep 28 21:54:51 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Flow 'volume_create_manager' (059d2a7a-e21c-4475-8a65-fbc7a4e6a5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a25550c-a91b-48c1-aec4-0545c162e1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a25550c-a91b-48c1-aec4-0545c162e1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1763240777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15429931-e84a-45da-ba9c-5c82eba5d459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0354175b75449b4a0b94cca3f8a3128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:51Z,use_quota=True,user_id='37a173ed8d464eaca2212bb1cfe5c7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6372b84d-5cbb-41bb-a4b1-0359ac49a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6372b84d-5cbb-41bb-a4b1-0359ac49a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83167db9-4b78-496c-a7b9-45052f71e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83167db9-4b78-496c-a7b9-45052f71e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15429931-e84a-45da-ba9c-5c82eba5d459', 'volume_name': 'volume-15429931-e84a-45da-ba9c-5c82eba5d459', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70803c2-903e-4e98-ae6c-3d0cca612b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70803c2-903e-4e98-ae6c-3d0cca612b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467c243f-11ba-4d4f-971d-88e163252292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:51 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Volume 15429931-e84a-45da-ba9c-5c82eba5d459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15429931-e84a-45da-ba9c-5c82eba5d459', 'volume_size': 1} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1763240777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15429931-e84a-45da-ba9c-5c82eba5d459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0354175b75449b4a0b94cca3f8a3128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:51Z,use_quota=True,user_id='37a173ed8d464eaca2212bb1cfe5c7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Creating volume 15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:51 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:51 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" returned: 0 in 0.495s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:51 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 1073741824 Sep 28 21:54:51 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:51 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2 Sep 28 21:54:51 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:51 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD" returned: 1 in 0.410s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Temporary image 2dcfada8-11df-4d4a-998b-e3ca04a9236b is fetched for user 7d3750a970fa4d4f99aa3e74513ee5dd. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d6bdab-8d14-4b40-98ba-42e104e58591]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:51 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" returned: 0 in 0.314s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-quobyte-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2" released by "delete_volume" :: held 0.920s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:51 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD Sep 28 21:54:51 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:51 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Created reservations ['01c3c2cb-3298-414e-8a86-9e7a0029a793', '5e687dde-1b26-4fb4-b70e-1b43c7e66ebc', 'ad09870f-f52a-425b-98cd-c8327d5a4140', 'bd14e7c7-6d38-4746-8b4f-9b679cb66897'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:52 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 1073741824" returned: 0 in 0.602s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:52 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:52 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:52 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 Sep 28 21:54:52 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:52 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:52 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD Sep 28 21:54:52 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:52 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.291s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Deleted volume successfully. Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-49ddcc64-b4bb-47f3-8fa9-319c2d3e2739 tempest-CreateVolumesFromSnapshotTest-225403594 None] Lock "cinder-f5dcc5dd-11d8-4c5f-af5f-5e0c95baebf2-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:52 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459" returned: 0 in 0.336s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467c243f-11ba-4d4f-971d-88e163252292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15429931-e84a-45da-ba9c-5c82eba5d459', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9eac2e-b872-4eca-8197-6a36304f46b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:52 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Volume volume-15429931-e84a-45da-ba9c-5c82eba5d459 (15429931-e84a-45da-ba9c-5c82eba5d459): created successfully Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9eac2e-b872-4eca-8197-6a36304f46b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Flow 'volume_create_manager' (059d2a7a-e21c-4475-8a65-fbc7a4e6a5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:52 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-27695d81-bca1-4a85-86fa-f25d4baea79b tempest-VolumeDependencyTests-1378190570 None] Created volume successfully. Sep 28 21:54:52 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe4694b-22f3-4b0b-8051-9d9f9d96b824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07f52e2625e4aae9ca0909dbca79734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:50Z,use_quota=True,user_id='7d3750a970fa4d4f99aa3e74513ee5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Creating volume 0fe4694b-22f3-4b0b-8051-9d9f9d96b824 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:52 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:54:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:52 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 1073741824 Sep 28 21:54:52 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:53 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 1073741824" returned: 0 in 0.484s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:53 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 Sep 28 21:54:53 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:53 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824" returned: 0 in 0.264s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Attempting download of 2dcfada8-11df-4d4a-998b-e3ca04a9236b ((None, [{'url': 'file:///opt/stack/data/glance/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'metadata': {}}])) to volume 0fe4694b-22f3-4b0b-8051-9d9f9d96b824. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78e370-17fe-4744-a3b3-78e3ef4049fc]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dcfada8-11df-4d4a-998b-e3ca04a9236b_jz0_9w8k {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:53 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dcfada8-11df-4d4a-998b-e3ca04a9236b_jz0_9w8k Sep 28 21:54:53 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Creating offline snapshot 07ed75c2-b710-4f2d-af29-5d3d6e23daaa of volume 15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c598900-c4fc-4aaa-ae51-48ca61d1a716]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:53 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 Sep 28 21:54:53 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:54 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dcfada8-11df-4d4a-998b-e3ca04a9236b_jz0_9w8k" returned: 0 in 0.473s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dcfada8-11df-4d4a-998b-e3ca04a9236b_jz0_9w8k {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:54 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dcfada8-11df-4d4a-998b-e3ca04a9236b_jz0_9w8k Sep 28 21:54:54 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:54 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459" returned: 0 in 0.495s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:54 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa 1G Sep 28 21:54:54 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:54 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dcfada8-11df-4d4a-998b-e3ca04a9236b_jz0_9w8k" returned: 1 in 0.415s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dcfada8-11df-4d4a-998b-e3ca04a9236b_jz0_9w8k' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b5d535-362c-476d-ab1a-38bbb10e3b31]: (4, 'raw') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:54 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD Sep 28 21:54:54 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:54 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:54 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa 1G" returned: 0 in 0.523s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:54 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15429931-e84a-45da-ba9c-5c82eba5d459 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:54 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15429931-e84a-45da-ba9c-5c82eba5d459 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa Sep 28 21:54:54 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:54 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD Sep 28 21:54:54 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:55 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD' failed. Not Retrying. {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] 2dcfada8-11df-4d4a-998b-e3ca04a9236b was raw, converting to qcow2 {{(pid=86489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:55 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 Sep 28 21:54:55 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:55 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15429931-e84a-45da-ba9c-5c82eba5d459 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa" returned: 0 in 0.446s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:55 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa is being set with open permissions: ugo+rw Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:55 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa Sep 28 21:54:55 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:55 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa" returned: 0 in 0.269s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:55 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.info Sep 28 21:54:55 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:55 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824" returned: 0 in 0.532s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2dcfada8-11df-4d4a-998b-e3ca04a9236b_o_ylvq56devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:54:55 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:55 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 1G Sep 28 21:54:55 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:55 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.info" returned: 0 in 0.283s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:55 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.info is being set with open permissions: ugo+rw Sep 28 21:54:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:55 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.info Sep 28 21:54:55 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:56 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 1G" returned: 0 in 0.364s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Downloaded image 2dcfada8-11df-4d4a-998b-e3ca04a9236b ((None, [{'url': 'file:///opt/stack/data/glance/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'metadata': {}}])) to volume 0fe4694b-22f3-4b0b-8051-9d9f9d96b824 successfully. {{(pid=86489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Temporary image 2dcfada8-11df-4d4a-998b-e3ca04a9236b for user 7d3750a970fa4d4f99aa3e74513ee5dd is deleted. {{(pid=86489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.volume.volume_utils [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Marking volume 0fe4694b-22f3-4b0b-8051-9d9f9d96b824 as bootable. {{(pid=86489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Copying metadata from image 2dcfada8-11df-4d4a-998b-e3ca04a9236b to 0fe4694b-22f3-4b0b-8051-9d9f9d96b824. {{(pid=86489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Creating volume glance metadata for volume 0fe4694b-22f3-4b0b-8051-9d9f9d96b824 backed by image 2dcfada8-11df-4d4a-998b-e3ca04a9236b with: {'image_id': '2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '21356b1a718e908ab335a5a5729d9136', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 21:54:56 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.info" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5676426-a4c2-4c10-8f8a-399b2cff9a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824', 'volume_size': 1, 'image_id': '2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21356b1a718e908ab335a5a5729d9136', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b07f52e2625e4aae9ca0909dbca79734', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c98c56a071fcadc0d225fe1633704134d7d7ddaf85e235fdec0541118041b0652a973e8398660d7424999bf2de8e1143c0868ad5c6df901dd6d7980aaf957d8c', 'id': '2dcfada8-11df-4d4a-998b-e3ca04a9236b', 'created_at': datetime.datetime(2026, 9, 28, 19, 54, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 19, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dcfada8-11df-4d4a-998b-e3ca04a9236b/file', 'properties': {}}, 'image_service': }' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4abe81-c2b0-4b2d-a6a2-d6494d00b1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:56 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Volume volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 (0fe4694b-22f3-4b0b-8051-9d9f9d96b824): created successfully Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4abe81-c2b0-4b2d-a6a2-d6494d00b1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Flow 'volume_create_manager' (736c7076-c199-4222-a984-a7cecdb34c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9cdd0e70-07f0-4d82-ad05-b5eef27dac87 tempest-VolumeDependencyTests-1378190570 None] Create snapshot completed successfully Sep 28 21:54:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8718ef38-379a-4832-b625-dec498d6fb82 tempest-VolumeImageDependencyTests-825408382 None] Created volume successfully. Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Acquiring lock "cinder-0fe4694b-22f3-4b0b-8051-9d9f9d96b824-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Lock "cinder-0fe4694b-22f3-4b0b-8051-9d9f9d96b824-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Acquiring lock "cinder-quobyte-0fe4694b-22f3-4b0b-8051-9d9f9d96b824" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Lock "cinder-quobyte-0fe4694b-22f3-4b0b-8051-9d9f9d96b824" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0eda7c-472f-4e05-b227-fed8bd8f76f0]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Flow 'volume_create_manager' (a0f70782-26d4-4a02-9def-973603056274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0481ee8-ab10-439e-b205-28fb1b2e2d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0481ee8-ab10-439e-b205-28fb1b2e2d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1047441435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3693c2e4-625b-4626-a269-ad49adeec66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0354175b75449b4a0b94cca3f8a3128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07ed75c2-b710-4f2d-af29-5d3d6e23daaa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:54:58Z,use_quota=True,user_id='37a173ed8d464eaca2212bb1cfe5c7ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a52661-25a1-44c2-b76a-8d7e3a71cab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a52661-25a1-44c2-b76a-8d7e3a71cab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b88118-1030-44ea-95fe-8e9b5dc88651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b88118-1030-44ea-95fe-8e9b5dc88651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3693c2e4-625b-4626-a269-ad49adeec66c', 'volume_name': 'volume-3693c2e4-625b-4626-a269-ad49adeec66c', 'volume_size': 1, 'snapshot_id': '07ed75c2-b710-4f2d-af29-5d3d6e23daaa'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdecfea9-096a-4bc7-b13a-c62a0930f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdecfea9-096a-4bc7-b13a-c62a0930f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a529bd3-c277-4360-9e5a-2020c5eb79a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:54:57 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Volume 3693c2e4-625b-4626-a269-ad49adeec66c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3693c2e4-625b-4626-a269-ad49adeec66c', 'volume_size': 1, 'snapshot_id': '07ed75c2-b710-4f2d-af29-5d3d6e23daaa'} Sep 28 21:54:57 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 Sep 28 21:54:57 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-quobyte-07ed75c2-b710-4f2d-af29-5d3d6e23daaa-3693c2e4-625b-4626-a269-ad49adeec66c" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-07ed75c2-b710-4f2d-af29-5d3d6e23daaa-3693c2e4-625b-4626-a269-ad49adeec66c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Creating volume 3693c2e4-625b-4626-a269-ad49adeec66c from snapshot 07ed75c2-b710-4f2d-af29-5d3d6e23daaa {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-quobyte-3693c2e4-625b-4626-a269-ad49adeec66c" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-3693c2e4-625b-4626-a269-ad49adeec66c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] snapshot: 07ed75c2-b710-4f2d-af29-5d3d6e23daaa, volume: 3693c2e4-625b-4626-a269-ad49adeec66c, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b976ce-e6aa-465c-8bb0-fc4c54482e47]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:58 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa Sep 28 21:54:58 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:58 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824" returned: 0 in 0.407s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:58 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824 Sep 28 21:54:58 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:58 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa" returned: 0 in 0.439s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15429931-e84a-45da-ba9c-5c82eba5d459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4e9cf8-1b07-4591-8b8a-97b13381865e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:58 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-0fe4694b-22f3-4b0b-8051-9d9f9d96b824" returned: 0 in 0.307s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Lock "cinder-quobyte-0fe4694b-22f3-4b0b-8051-9d9f9d96b824" released by "delete_volume" :: held 0.791s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:54:58 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 Sep 28 21:54:58 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Created reservations ['b412cd9f-ad5c-4718-bfc9-a938ccd1f7e7', 'fd8574e0-7815-43cc-bc7d-61b7cfa95144', 'e9bf8f6e-7b8d-4b99-a0ac-342a762f3f0c', '8f6b5bb0-5579-410f-b3be-81cef779654b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:54:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:58 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:54:58 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:59 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459" returned: 0 in 0.571s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:54:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:54:59 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:54:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:54:59 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c Sep 28 21:54:59 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:54:59 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 28 21:54:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.418s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:54:59 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:54:59 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Deleted volume successfully. Sep 28 21:54:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-d2661b27-a1f9-4399-8dbc-581db7c918db tempest-VolumeImageDependencyTests-825408382 None] Lock "cinder-0fe4694b-22f3-4b0b-8051-9d9f9d96b824-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Flow 'volume_create_manager' (0039b4a3-f3c2-4dc5-840a-0eb3423039f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276a98b3-4a11-41d8-9f44-258b3124acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276a98b3-4a11-41d8-9f44-258b3124acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635d52ec-804f-4ee0-8020-a126120ce4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b386c11202e4ef68d26a48fd46acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:07Z,use_quota=True,user_id='d49fd19ae4034d6a9284b1ceb1db9b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05806d3-bdf0-42d7-8b03-077e0a81fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05806d3-bdf0-42d7-8b03-077e0a81fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04439644-1212-4b9b-bb20-cec7b5cd687f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04439644-1212-4b9b-bb20-cec7b5cd687f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635d52ec-804f-4ee0-8020-a126120ce4ec', 'volume_name': 'volume-635d52ec-804f-4ee0-8020-a126120ce4ec', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1aa454-27e1-4b5c-8950-9c319d220f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1aa454-27e1-4b5c-8950-9c319d220f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f156ff9-e2e9-4f5b-a71e-32cabfcdddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Volume 635d52ec-804f-4ee0-8020-a126120ce4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635d52ec-804f-4ee0-8020-a126120ce4ec', 'volume_size': 1} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:07 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:07 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:07 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c" returned: 0 in 8.625s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:55:07 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Converted 1024.00 MB image at 118.70 MB/s Sep 28 21:55:07 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c is being set with open permissions: ugo+rw Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:07 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c Sep 28 21:55:07 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:07 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.426s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:55:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:55:08 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Flow 'volume_create_manager' (280bdc21-b5cb-4334-a2b9-49a1aafbb4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133ef18f-f330-4f1b-8290-f335b7d8de2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c" returned: 0 in 0.403s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-3693c2e4-625b-4626-a269-ad49adeec66c" released by "_copy_volume_from_snapshot" :: held 10.159s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133ef18f-f330-4f1b-8290-f335b7d8de2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351999771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70566806-8e5f-4f8b-b36f-6e8265dd6457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690328193e5a4ed791bc3d2006a6e112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:08Z,use_quota=True,user_id='538ed2727b684f269db5f99c30d13110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7315ce0a-c913-4bf9-bb5c-ed043c845cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7315ce0a-c913-4bf9-bb5c-ed043c845cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bc0a90-1849-4835-8dd0-6fe38b80789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bc0a90-1849-4835-8dd0-6fe38b80789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70566806-8e5f-4f8b-b36f-6e8265dd6457', 'volume_name': 'volume-70566806-8e5f-4f8b-b36f-6e8265dd6457', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888a3e09-7370-4750-990d-986fc3501b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888a3e09-7370-4750-990d-986fc3501b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772fd153-4869-4d18-8867-6bb4da4057b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:08 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Volume 70566806-8e5f-4f8b-b36f-6e8265dd6457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70566806-8e5f-4f8b-b36f-6e8265dd6457', 'volume_size': 1} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-07ed75c2-b710-4f2d-af29-5d3d6e23daaa-3693c2e4-625b-4626-a269-ad49adeec66c" released by "_create_volume_from_snapshot" :: held 10.270s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.287s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635d52ec-804f-4ee0-8020-a126120ce4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b386c11202e4ef68d26a48fd46acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:07Z,use_quota=True,user_id='d49fd19ae4034d6a9284b1ceb1db9b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Creating volume 635d52ec-804f-4ee0-8020-a126120ce4ec {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:08 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:08 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec 1073741824 Sep 28 21:55:08 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a529bd3-c277-4360-9e5a-2020c5eb79a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3693c2e4-625b-4626-a269-ad49adeec66c', 'volume_size': 1, 'snapshot_id': '07ed75c2-b710-4f2d-af29-5d3d6e23daaa'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d068a5-21a0-4fdd-9941-4b5f833e6702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:08 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Volume volume-3693c2e4-625b-4626-a269-ad49adeec66c (3693c2e4-625b-4626-a269-ad49adeec66c): created successfully Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d068a5-21a0-4fdd-9941-4b5f833e6702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Flow 'volume_create_manager' (a0f70782-26d4-4a02-9def-973603056274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6e63d4ce-cd4a-4156-ad8d-7f7103d4cae9 tempest-VolumeDependencyTests-1378190570 None] Created volume successfully. Sep 28 21:55:08 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec 1073741824" returned: 0 in 0.541s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:08 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec Sep 28 21:55:08 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:09 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec" returned: 0 in 0.363s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351999771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70566806-8e5f-4f8b-b36f-6e8265dd6457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690328193e5a4ed791bc3d2006a6e112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:08Z,use_quota=True,user_id='538ed2727b684f269db5f99c30d13110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Creating volume 70566806-8e5f-4f8b-b36f-6e8265dd6457 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:09 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-07ed75c2-b710-4f2d-af29-5d3d6e23daaa-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:09 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 1073741824 Sep 28 21:55:09 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f156ff9-e2e9-4f5b-a71e-32cabfcdddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635d52ec-804f-4ee0-8020-a126120ce4ec', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b477a02-2b58-412a-996c-13e6af8f35c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-07ed75c2-b710-4f2d-af29-5d3d6e23daaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-quobyte-15429931-e84a-45da-ba9c-5c82eba5d459" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:09 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Volume volume-635d52ec-804f-4ee0-8020-a126120ce4ec (635d52ec-804f-4ee0-8020-a126120ce4ec): created successfully Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b477a02-2b58-412a-996c-13e6af8f35c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Flow 'volume_create_manager' (0039b4a3-f3c2-4dc5-840a-0eb3423039f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-15429931-e84a-45da-ba9c-5c82eba5d459" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-quobyte-07ed75c2-b710-4f2d-af29-5d3d6e23daaa" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:09 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-28621f1f-2ed3-44af-9ae0-a84eaa36a694 tempest-CinderUnicodeTest-309884893 None] Created volume successfully. Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-07ed75c2-b710-4f2d-af29-5d3d6e23daaa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Deleting offline snapshot 07ed75c2-b710-4f2d-af29-5d3d6e23daaa of volume 15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] snapshot_file for this snap is: volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d1662c-7869-444c-81ce-1364e900994b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:09 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa Sep 28 21:55:09 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:09 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 1073741824" returned: 0 in 0.484s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:09 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 Sep 28 21:55:09 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:09 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa" returned: 0 in 0.439s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15429931-e84a-45da-ba9c-5c82eba5d459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e09fa38-47b5-47bb-8a28-4d786879a401]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:09 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 Sep 28 21:55:09 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:09 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457" returned: 0 in 0.267s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772fd153-4869-4d18-8867-6bb4da4057b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70566806-8e5f-4f8b-b36f-6e8265dd6457', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ce50f1-6e9e-4f0b-9bf5-4efb746f8b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:09 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Volume volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 (70566806-8e5f-4f8b-b36f-6e8265dd6457): created successfully Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ce50f1-6e9e-4f0b-9bf5-4efb746f8b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:09 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Flow 'volume_create_manager' (280bdc21-b5cb-4334-a2b9-49a1aafbb4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-364989b1-85bd-4478-91f1-7e021081e7c8 tempest-ProjectReaderTests-1251290084 None] Created volume successfully. Sep 28 21:55:10 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459" returned: 0 in 0.578s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:10 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa Sep 28 21:55:10 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:10 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa" returned: 0 in 0.405s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:10 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa Sep 28 21:55:10 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Flow 'volume_create_manager' (cf12d2b3-196c-4ee4-bf8b-7f1f8caf0cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9988c75-1bb3-474b-a846-ed1c0430c1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9988c75-1bb3-474b-a846-ed1c0430c1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1375880724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86816ce-0bf6-444a-bac0-00bd735daf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b386c11202e4ef68d26a48fd46acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:11Z,use_quota=True,user_id='d49fd19ae4034d6a9284b1ceb1db9b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99a8d60-d619-4618-b664-58042926616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99a8d60-d619-4618-b664-58042926616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fa1b24-0f39-4d97-a29a-667a343018a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fa1b24-0f39-4d97-a29a-667a343018a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e86816ce-0bf6-444a-bac0-00bd735daf78', 'volume_name': 'volume-e86816ce-0bf6-444a-bac0-00bd735daf78', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5317255e-81d9-48a0-a71b-c01a2c4428f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5317255e-81d9-48a0-a71b-c01a2c4428f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ee1f55-5ea4-472b-a186-8196fe846603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:10 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Volume e86816ce-0bf6-444a-bac0-00bd735daf78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e86816ce-0bf6-444a-bac0-00bd735daf78', 'volume_size': 1} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1375880724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86816ce-0bf6-444a-bac0-00bd735daf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b386c11202e4ef68d26a48fd46acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:11Z,use_quota=True,user_id='d49fd19ae4034d6a9284b1ceb1db9b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Creating volume e86816ce-0bf6-444a-bac0-00bd735daf78 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:10 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:10 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 1073741824 Sep 28 21:55:10 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:11 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459.07ed75c2-b710-4f2d-af29-5d3d6e23daaa" returned: 0 in 0.342s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-07ed75c2-b710-4f2d-af29-5d3d6e23daaa" released by "_delete_snapshot" :: held 1.912s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-15429931-e84a-45da-ba9c-5c82eba5d459" released by "delete_snapshot" :: held 1.947s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Created reservations ['0bbd27c1-822f-44ba-861c-229987af207b', '7900207f-beed-4f85-bd5a-b7793f6687cf', '6560bd94-34e5-4efa-8338-9950742974aa', 'f2859017-cf2c-4fef-8ad6-0920d961ccba'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Delete snapshot completed successfully. Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-40b8df92-a04d-4076-9867-7df54e320886 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-07ed75c2-b710-4f2d-af29-5d3d6e23daaa-delete_snapshot" released by "delete_snapshot" :: held 2.161s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:11 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 1073741824" returned: 0 in 0.573s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Acquiring lock "cinder-70566806-8e5f-4f8b-b36f-6e8265dd6457-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:11 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 Sep 28 21:55:11 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Lock "cinder-70566806-8e5f-4f8b-b36f-6e8265dd6457-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Acquiring lock "cinder-quobyte-70566806-8e5f-4f8b-b36f-6e8265dd6457" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Lock "cinder-quobyte-70566806-8e5f-4f8b-b36f-6e8265dd6457" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e1c41c-d223-4a5a-ace1-c4459bbd6142]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:11 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 Sep 28 21:55:11 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:11 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ee1f55-5ea4-472b-a186-8196fe846603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e86816ce-0bf6-444a-bac0-00bd735daf78', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a44eb35-ca49-4e55-b853-bc7b55c23183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:11 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Volume volume-e86816ce-0bf6-444a-bac0-00bd735daf78 (e86816ce-0bf6-444a-bac0-00bd735daf78): created successfully Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a44eb35-ca49-4e55-b853-bc7b55c23183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:11 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Flow 'volume_create_manager' (cf12d2b3-196c-4ee4-bf8b-7f1f8caf0cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-cfdfdb1d-353c-4c68-ae8d-6b8342168e5e tempest-CinderUnicodeTest-309884893 None] Created volume successfully. Sep 28 21:55:12 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457" returned: 0 in 0.404s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:12 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457 Sep 28 21:55:12 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-15429931-e84a-45da-ba9c-5c82eba5d459-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:12 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-70566806-8e5f-4f8b-b36f-6e8265dd6457" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Lock "cinder-quobyte-70566806-8e5f-4f8b-b36f-6e8265dd6457" released by "delete_volume" :: held 0.738s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-15429931-e84a-45da-ba9c-5c82eba5d459-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-quobyte-15429931-e84a-45da-ba9c-5c82eba5d459" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-15429931-e84a-45da-ba9c-5c82eba5d459" acquired by "delete_volume" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[354aef05-5973-4483-bd40-4f45838175b9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Created reservations ['77ebcd73-ebde-4b54-8749-a48d44367b40', '464f4847-ddc6-498e-a849-c4d974dcf097', '345ff7ac-3821-4a5c-afb6-e5162eacd3b6', 'b571d08e-7c25-4496-82fc-5a04adcbb117'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:12 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 Sep 28 21:55:12 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:12 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:12 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:13 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459" returned: 0 in 0.477s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:13 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.385s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:13 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459 Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:13 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:13 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Deleted volume successfully. Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-86a26312-74d9-4650-95f9-b8aa5c77f5da tempest-ProjectReaderTests-1251290084 None] Lock "cinder-70566806-8e5f-4f8b-b36f-6e8265dd6457-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:13 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-15429931-e84a-45da-ba9c-5c82eba5d459" returned: 0 in 0.378s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-15429931-e84a-45da-ba9c-5c82eba5d459" released by "delete_volume" :: held 0.941s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Created reservations ['79f3c280-d820-4c08-89e6-de6cac406dce', '582a6c88-d0bf-4ae2-a10e-1dbfc533f32a', '6b524382-9d04-4e6a-9899-634079c6d765', '4f983230-3744-4ab2-b54c-0e78a77a76e5'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Creating offline snapshot 0226c7b4-fe64-4c12-a840-3d92f8dd97d5 of volume e86816ce-0bf6-444a-bac0-00bd735daf78 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3ac10d-1b83-4e6b-8755-39c46a23cc85]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:13 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:13 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Flow 'volume_create_manager' (af35809a-9018-4cad-a115-31537a6caad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1397940e-487f-4de0-bc82-3db453cc6971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:13 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 Sep 28 21:55:13 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1397940e-487f-4de0-bc82-3db453cc6971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638088620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fa4fcf-7085-4b29-8783-d425efd1d650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690328193e5a4ed791bc3d2006a6e112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:14Z,use_quota=True,user_id='538ed2727b684f269db5f99c30d13110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49bbd83-bd23-4893-82d0-7cbd3707132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49bbd83-bd23-4893-82d0-7cbd3707132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9932c7c-5ab4-49ee-ad7e-0dc4b31721dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9932c7c-5ab4-49ee-ad7e-0dc4b31721dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0fa4fcf-7085-4b29-8783-d425efd1d650', 'volume_name': 'volume-a0fa4fcf-7085-4b29-8783-d425efd1d650', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b82080-45f2-406c-9be4-0654f6d691c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b82080-45f2-406c-9be4-0654f6d691c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3a6c32-e132-4f0d-a5e1-5dc5277a6d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:13 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Volume a0fa4fcf-7085-4b29-8783-d425efd1d650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0fa4fcf-7085-4b29-8783-d425efd1d650', 'volume_size': 1} Sep 28 21:55:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:14 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.383s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:14 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Deleted volume successfully. Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3ac98f25-2f38-47d8-aed6-fdb868581146 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-15429931-e84a-45da-ba9c-5c82eba5d459-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:14 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78" returned: 0 in 0.482s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:14 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 1G Sep 28 21:55:14 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:14 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 1G" returned: 0 in 0.435s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86816ce-0bf6-444a-bac0-00bd735daf78 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:14 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86816ce-0bf6-444a-bac0-00bd735daf78 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 Sep 28 21:55:14 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-3693c2e4-625b-4626-a269-ad49adeec66c-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-3693c2e4-625b-4626-a269-ad49adeec66c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "cinder-quobyte-3693c2e4-625b-4626-a269-ad49adeec66c" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-3693c2e4-625b-4626-a269-ad49adeec66c" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc271f30-c1dd-4415-93eb-7a4f047f60c9]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:14 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86816ce-0bf6-444a-bac0-00bd735daf78 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5" returned: 0 in 0.361s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:14 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 is being set with open permissions: ugo+rw Sep 28 21:55:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:14 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 Sep 28 21:55:14 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:14 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c Sep 28 21:55:14 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:15 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:15 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.info Sep 28 21:55:15 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:15 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c" returned: 0 in 0.421s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:15 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c Sep 28 21:55:15 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:15 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.info" returned: 0 in 0.300s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:15 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.info is being set with open permissions: ugo+rw Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:15 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3693c2e4-625b-4626-a269-ad49adeec66c" returned: 0 in 0.287s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:15 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.info Sep 28 21:55:15 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-quobyte-3693c2e4-625b-4626-a269-ad49adeec66c" released by "delete_volume" :: held 0.768s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Created reservations ['34845c13-2d2f-4030-90c5-748adac53be2', '9ee27a92-6312-4efb-ab4d-bc77513f9e4e', 'c714b5c8-f690-4cc0-8b12-40c84a8471d2', 'e1fb9747-4e32-4b1c-8280-744d83cb24a1'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:15 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:15 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:15 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.info" returned: 0 in 0.296s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.980s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638088620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fa4fcf-7085-4b29-8783-d425efd1d650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690328193e5a4ed791bc3d2006a6e112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:14Z,use_quota=True,user_id='538ed2727b684f269db5f99c30d13110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Creating volume a0fa4fcf-7085-4b29-8783-d425efd1d650 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:15 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:15 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 1073741824 Sep 28 21:55:15 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7482afe2-952a-4c2c-a098-5b92e4bc6f51 tempest-CinderUnicodeTest-309884893 None] Create snapshot completed successfully Sep 28 21:55:15 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.307s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Deleted volume successfully. Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-10989c35-0d13-48c9-ad2c-f4f642f0f413 tempest-VolumeDependencyTests-1378190570 None] Lock "cinder-3693c2e4-625b-4626-a269-ad49adeec66c-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:16 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 1073741824" returned: 0 in 0.542s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:16 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 Sep 28 21:55:16 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "cinder-0226c7b4-fe64-4c12-a840-3d92f8dd97d5-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-0226c7b4-fe64-4c12-a840-3d92f8dd97d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "cinder-quobyte-e86816ce-0bf6-444a-bac0-00bd735daf78" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-quobyte-e86816ce-0bf6-444a-bac0-00bd735daf78" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "cinder-quobyte-0226c7b4-fe64-4c12-a840-3d92f8dd97d5" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-quobyte-0226c7b4-fe64-4c12-a840-3d92f8dd97d5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Deleting offline snapshot 0226c7b4-fe64-4c12-a840-3d92f8dd97d5 of volume e86816ce-0bf6-444a-bac0-00bd735daf78 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] snapshot_file for this snap is: volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed3ee42-8356-4ae1-a0b4-ce3d38ed1704]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:16 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650" returned: 0 in 0.363s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3a6c32-e132-4f0d-a5e1-5dc5277a6d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fa4fcf-7085-4b29-8783-d425efd1d650', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3e3b9c-ccf0-4377-a074-0ecdeea57983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:16 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Volume volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 (a0fa4fcf-7085-4b29-8783-d425efd1d650): created successfully Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3e3b9c-ccf0-4377-a074-0ecdeea57983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Flow 'volume_create_manager' (af35809a-9018-4cad-a115-31537a6caad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-948192c9-d830-44e7-94e9-e2b723319f2f tempest-ProjectReaderTests-1251290084 None] Created volume successfully. Sep 28 21:55:16 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 Sep 28 21:55:16 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:17 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5" returned: 0 in 0.466s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e86816ce-0bf6-444a-bac0-00bd735daf78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dee7e2-d9bb-4615-96bc-2352eca25028]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:17 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 Sep 28 21:55:17 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:17 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78" returned: 0 in 0.608s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:17 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 Sep 28 21:55:17 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Acquiring lock "cinder-a0fa4fcf-7085-4b29-8783-d425efd1d650-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Lock "cinder-a0fa4fcf-7085-4b29-8783-d425efd1d650-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:17 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=259,cinder:SELECT=188,cinder:INSERT=72,cinder:DELETE=28 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=204,cinder:INSERT=71,cinder:UPDATE=282,cinder:DELETE=22 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Acquiring lock "cinder-quobyte-a0fa4fcf-7085-4b29-8783-d425efd1d650" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Lock "cinder-quobyte-a0fa4fcf-7085-4b29-8783-d425efd1d650" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e457e8ce-3f85-4540-8f02-cb69037bf7b3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:18 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 Sep 28 21:55:18 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:18 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5" returned: 0 in 0.701s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:18 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5 Sep 28 21:55:18 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:18 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650" returned: 0 in 0.553s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:18 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650 Sep 28 21:55:18 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:18 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78.0226c7b4-fe64-4c12-a840-3d92f8dd97d5" returned: 0 in 0.356s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:18 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-quobyte-0226c7b4-fe64-4c12-a840-3d92f8dd97d5" released by "_delete_snapshot" :: held 2.290s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-quobyte-e86816ce-0bf6-444a-bac0-00bd735daf78" released by "delete_snapshot" :: held 2.325s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Created reservations ['2a94e858-502f-4160-bc0f-bff85f6c7345', '7f8cf123-2d80-43c3-87df-c69f87a6347c', '10572b4c-16b5-4936-9ac1-86804302b3a1', '0569e32c-f85c-479e-ba03-bbacd4804cbb'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:19 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a0fa4fcf-7085-4b29-8783-d425efd1d650" returned: 0 in 0.336s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Lock "cinder-quobyte-a0fa4fcf-7085-4b29-8783-d425efd1d650" released by "delete_volume" :: held 0.960s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Delete snapshot completed successfully. Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-89789217-e61a-46d5-9d68-8be439f35f40 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-0226c7b4-fe64-4c12-a840-3d92f8dd97d5-delete_snapshot" released by "delete_snapshot" :: held 2.542s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Created reservations ['98ac7ae4-ab59-4f37-a174-ad3ec3844b29', 'e5b6d975-321f-47a0-8241-77e63736f112', 'eb0bf6b0-519f-4dec-add9-4395cc6ff7f6', '03627d94-734e-4f2a-a8e0-c7c75242b7a5'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:19 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:19 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:19 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.358s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Deleted volume successfully. Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f228afb3-0ebb-47ca-a3d2-afde40e033cb tempest-ProjectReaderTests-1251290084 None] Lock "cinder-a0fa4fcf-7085-4b29-8783-d425efd1d650-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "cinder-e86816ce-0bf6-444a-bac0-00bd735daf78-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-e86816ce-0bf6-444a-bac0-00bd735daf78-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "cinder-quobyte-e86816ce-0bf6-444a-bac0-00bd735daf78" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-quobyte-e86816ce-0bf6-444a-bac0-00bd735daf78" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:20 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82677b-aa94-4a14-8b4d-7fec01357bd8]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:20 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-cccd9266-99be-489e-b94e-6a9808aa0f48 tempest-ProjectAdminTests-207719706 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.050682067871, 'free_capacity_gb': 1775.050682067871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86489) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 21:55:20 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 Sep 28 21:55:20 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:20 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78" returned: 0 in 0.452s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:20 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78 Sep 28 21:55:20 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:20 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e86816ce-0bf6-444a-bac0-00bd735daf78" returned: 0 in 0.381s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-quobyte-e86816ce-0bf6-444a-bac0-00bd735daf78" released by "delete_volume" :: held 0.945s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Created reservations ['0690cf5c-5890-4d98-82a8-8449fc79c52f', '705a47b0-7156-4696-b49c-7bc713a8a5c5', 'ce726b06-fd3d-443e-b25d-129f3acbaf0d', 'd7600633-ba65-4eb3-be97-9b2d6dfdfcfc'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:21 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:21 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:21 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.268s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:21 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Deleted volume successfully. Sep 28 21:55:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7674619b-ce52-48a4-80ef-920ae7f17034 tempest-CinderUnicodeTest-309884893 None] Lock "cinder-e86816ce-0bf6-444a-bac0-00bd735daf78-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Acquiring lock "cinder-635d52ec-804f-4ee0-8020-a126120ce4ec-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Lock "cinder-635d52ec-804f-4ee0-8020-a126120ce4ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Acquiring lock "cinder-quobyte-635d52ec-804f-4ee0-8020-a126120ce4ec" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:22 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Lock "cinder-quobyte-635d52ec-804f-4ee0-8020-a126120ce4ec" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[783da5f0-0c3c-44b1-addf-930cc2cc94ff]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:22 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec Sep 28 21:55:22 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:22 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec" returned: 0 in 0.532s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:23 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec Sep 28 21:55:23 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:23 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-635d52ec-804f-4ee0-8020-a126120ce4ec" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Lock "cinder-quobyte-635d52ec-804f-4ee0-8020-a126120ce4ec" released by "delete_volume" :: held 0.929s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Created reservations ['9f1346b3-0f2c-4eea-906a-10e9c622ea04', '4f9e0da0-f7e1-46cf-ae81-2162ceb52373', 'f53b45e8-22f7-4afe-8f25-2296586a10b9', '8eaaa1f6-2100-4f55-87ee-38dca1d71e58'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:23 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:23 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:23 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.381s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Deleted volume successfully. Sep 28 21:55:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9ed47702-eee6-4acf-a986-4f9f36d7c5bc tempest-CinderUnicodeTest-309884893 None] Lock "cinder-635d52ec-804f-4ee0-8020-a126120ce4ec-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Flow 'volume_create_manager' (5181f303-948a-4ae6-a250-42228210fb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6996fded-cbf1-492d-9e6f-58027e7c5d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6996fded-cbf1-492d-9e6f-58027e7c5d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-727099978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7e5a40-f216-4bfa-9438-48add11e894e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad395cf5ca714c14bc8594e73f63af51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:26Z,use_quota=True,user_id='d9ba9d7d621549a7a6f6a9bf5b3b5c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8203dd-8f5d-4169-a2c0-4e3539efd787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8203dd-8f5d-4169-a2c0-4e3539efd787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd609467-ea54-4e33-8c8a-dd5a0fe46731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd609467-ea54-4e33-8c8a-dd5a0fe46731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f7e5a40-f216-4bfa-9438-48add11e894e', 'volume_name': 'volume-2f7e5a40-f216-4bfa-9438-48add11e894e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ccba79-63c4-4f84-8fec-a64055c4a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ccba79-63c4-4f84-8fec-a64055c4a188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f5fc80-603e-4ee4-9fb1-28881c01b278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Volume 2f7e5a40-f216-4bfa-9438-48add11e894e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f7e5a40-f216-4bfa-9438-48add11e894e', 'volume_size': 1} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-727099978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7e5a40-f216-4bfa-9438-48add11e894e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad395cf5ca714c14bc8594e73f63af51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:26Z,use_quota=True,user_id='d9ba9d7d621549a7a6f6a9bf5b3b5c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Creating volume 2f7e5a40-f216-4bfa-9438-48add11e894e {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:26 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:26 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e 1073741824 Sep 28 21:55:26 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:26 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e 1073741824" returned: 0 in 0.706s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:26 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e Sep 28 21:55:26 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:27 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e" returned: 0 in 0.347s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:27 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f5fc80-603e-4ee4-9fb1-28881c01b278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f7e5a40-f216-4bfa-9438-48add11e894e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e28787-075d-457f-9f9f-dfb9b1bc2d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:27 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Volume volume-2f7e5a40-f216-4bfa-9438-48add11e894e (2f7e5a40-f216-4bfa-9438-48add11e894e): created successfully Sep 28 21:55:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e28787-075d-457f-9f9f-dfb9b1bc2d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:27 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Flow 'volume_create_manager' (5181f303-948a-4ae6-a250-42228210fb43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7bc7ab10-16a5-4c5e-910d-abf3ff3a506e tempest-ProjectReaderTests-346779204 None] Created volume successfully. Sep 28 21:55:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Acquiring lock "cinder-2f7e5a40-f216-4bfa-9438-48add11e894e-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Lock "cinder-2f7e5a40-f216-4bfa-9438-48add11e894e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Acquiring lock "cinder-quobyte-2f7e5a40-f216-4bfa-9438-48add11e894e" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Lock "cinder-quobyte-2f7e5a40-f216-4bfa-9438-48add11e894e" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[da872943-f6e1-4a39-bff0-1428f5eac641]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:28 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e Sep 28 21:55:28 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:29 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e" returned: 0 in 0.496s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:29 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e Sep 28 21:55:29 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:29 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-2f7e5a40-f216-4bfa-9438-48add11e894e" returned: 0 in 0.344s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Lock "cinder-quobyte-2f7e5a40-f216-4bfa-9438-48add11e894e" released by "delete_volume" :: held 0.910s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Created reservations ['a3bf9315-9a19-4e35-a6d1-771cce220560', 'af08bb17-bdba-4a80-b162-0c8dcc6bd41d', 'a51b5e75-75ad-4879-aaaf-032008d03cb5', 'f97bbbf6-8b87-498f-b9b3-5ee91e391881'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:29 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:29 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:30 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.294s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Deleted volume successfully. Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df897d89-8fb3-4e03-8843-03c2cd1cbd1a tempest-ProjectReaderTests-346779204 None] Lock "cinder-2f7e5a40-f216-4bfa-9438-48add11e894e-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (91e5677d-cfc8-4bca-800d-5679051470f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40beba6d-7373-46c9-a1a3-e371151fe346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40beba6d-7373-46c9-a1a3-e371151fe346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1236248284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e24be3-71fb-4e9b-89f9-dce69658af44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:30Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae14038e-b727-45d7-80df-2467d0456491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae14038e-b727-45d7-80df-2467d0456491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee3faed-1146-47b8-b04e-bf430839c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee3faed-1146-47b8-b04e-bf430839c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e24be3-71fb-4e9b-89f9-dce69658af44', 'volume_name': 'volume-55e24be3-71fb-4e9b-89f9-dce69658af44', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc523d3c-55ce-4d3f-bce6-fb99fa983528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc523d3c-55ce-4d3f-bce6-fb99fa983528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40a4368-5d10-4ee3-a9d3-838b966dc74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:30 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Volume 55e24be3-71fb-4e9b-89f9-dce69658af44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e24be3-71fb-4e9b-89f9-dce69658af44', 'volume_size': 1} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1236248284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e24be3-71fb-4e9b-89f9-dce69658af44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:30Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Creating volume 55e24be3-71fb-4e9b-89f9-dce69658af44 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:30 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:30 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 1073741824 Sep 28 21:55:30 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:31 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 1073741824" returned: 0 in 0.733s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:31 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 Sep 28 21:55:31 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Flow 'volume_create_manager' (9b0384b9-8476-473c-ab7e-a6bda8d32321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d8aea4-1670-4bef-befe-39e17cfa83f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d8aea4-1670-4bef-befe-39e17cfa83f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607381866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2c6f15-5c32-43ca-ba61-0d03114119da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad395cf5ca714c14bc8594e73f63af51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:31Z,use_quota=True,user_id='d9ba9d7d621549a7a6f6a9bf5b3b5c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5b5be7-da86-49ae-8c56-10dff23136c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5b5be7-da86-49ae-8c56-10dff23136c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c146addb-cd37-4708-aef5-f1d449613cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c146addb-cd37-4708-aef5-f1d449613cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2c6f15-5c32-43ca-ba61-0d03114119da', 'volume_name': 'volume-7d2c6f15-5c32-43ca-ba61-0d03114119da', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:31 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4ffdb0-03c6-4a0b-8542-266ee144778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4ffdb0-03c6-4a0b-8542-266ee144778f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab0e9a6-7409-42c2-8655-0cff20cd6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Volume 7d2c6f15-5c32-43ca-ba61-0d03114119da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2c6f15-5c32-43ca-ba61-0d03114119da', 'volume_size': 1} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44" returned: 0 in 0.326s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607381866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2c6f15-5c32-43ca-ba61-0d03114119da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad395cf5ca714c14bc8594e73f63af51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:31Z,use_quota=True,user_id='d9ba9d7d621549a7a6f6a9bf5b3b5c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Creating volume 7d2c6f15-5c32-43ca-ba61-0d03114119da {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:31 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40a4368-5d10-4ee3-a9d3-838b966dc74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e24be3-71fb-4e9b-89f9-dce69658af44', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:31 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da 1073741824 Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4270feb8-cf10-43c2-9d40-1b3c8945a0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:31 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:31 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Volume volume-55e24be3-71fb-4e9b-89f9-dce69658af44 (55e24be3-71fb-4e9b-89f9-dce69658af44): created successfully Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4270feb8-cf10-43c2-9d40-1b3c8945a0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:31 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (91e5677d-cfc8-4bca-800d-5679051470f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:31 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bc46782e-fcb1-4a83-aaf0-5d0a323e2e30 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (cf43d7a0-4df1-451c-a442-41887f6d46eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3111610-e477-4f5c-ba1c-3a5af1fb143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3111610-e477-4f5c-ba1c-3a5af1fb143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902387189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f29596-33d8-4aba-864e-ad001fd3a298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:32Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9524ffe-3b43-446d-af8b-9881135ff7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9524ffe-3b43-446d-af8b-9881135ff7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf94185d-a2f3-4066-b289-152ea0f11b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf94185d-a2f3-4066-b289-152ea0f11b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f29596-33d8-4aba-864e-ad001fd3a298', 'volume_name': 'volume-11f29596-33d8-4aba-864e-ad001fd3a298', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fd792b-94a0-48d1-81ea-8cc9b10c0059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fd792b-94a0-48d1-81ea-8cc9b10c0059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b484e20b-b01c-4c94-b207-be1f4ef6967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Volume 11f29596-33d8-4aba-864e-ad001fd3a298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f29596-33d8-4aba-864e-ad001fd3a298', 'volume_size': 1} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:32 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da 1073741824" returned: 0 in 0.613s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:32 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da Sep 28 21:55:32 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:32 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902387189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f29596-33d8-4aba-864e-ad001fd3a298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:32Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Creating volume 11f29596-33d8-4aba-864e-ad001fd3a298 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:32 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab0e9a6-7409-42c2-8655-0cff20cd6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2c6f15-5c32-43ca-ba61-0d03114119da', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:32 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 1073741824 Sep 28 21:55:32 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28121ad4-c5e8-414b-8442-24abdac66a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Volume volume-7d2c6f15-5c32-43ca-ba61-0d03114119da (7d2c6f15-5c32-43ca-ba61-0d03114119da): created successfully Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28121ad4-c5e8-414b-8442-24abdac66a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Flow 'volume_create_manager' (9b0384b9-8476-473c-ab7e-a6bda8d32321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-bda2444c-db41-4c45-81dd-2faab6d4efc9 tempest-ProjectReaderTests-346779204 None] Created volume successfully. Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:33 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 1073741824" returned: 0 in 0.594s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:33 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 Sep 28 21:55:33 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Acquiring lock "cinder-7d2c6f15-5c32-43ca-ba61-0d03114119da-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Lock "cinder-7d2c6f15-5c32-43ca-ba61-0d03114119da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:33 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298" returned: 0 in 0.418s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.824s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b484e20b-b01c-4c94-b207-be1f4ef6967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f29596-33d8-4aba-864e-ad001fd3a298', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d44b4f-95bb-46b5-84a0-8d947ee8173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Creating offline snapshot aad39a3b-eeea-4e11-8ce0-277ec125170a of volume 55e24be3-71fb-4e9b-89f9-dce69658af44 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Acquiring lock "cinder-quobyte-7d2c6f15-5c32-43ca-ba61-0d03114119da" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Volume volume-11f29596-33d8-4aba-864e-ad001fd3a298 (11f29596-33d8-4aba-864e-ad001fd3a298): created successfully Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d44b4f-95bb-46b5-84a0-8d947ee8173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (cf43d7a0-4df1-451c-a442-41887f6d46eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3013284b-2e7b-4c31-8f37-e4a9092523fd]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:33 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Lock "cinder-quobyte-7d2c6f15-5c32-43ca-ba61-0d03114119da" acquired by "delete_volume" :: waited 0.079s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:34 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f5e9134e-8534-4cbc-902c-088ed7e6f507 tempest-ProjectReaderTests-451017063 None] Created volume successfully. Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8828e23a-ddb3-4294-aab1-9d94e4bf43f7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:34 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 Sep 28 21:55:34 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:34 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da Sep 28 21:55:34 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:34 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da" returned: 0 in 0.562s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:34 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44" returned: 0 in 0.678s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:34 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da Sep 28 21:55:34 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:34 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a 1G Sep 28 21:55:34 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:34 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-7d2c6f15-5c32-43ca-ba61-0d03114119da" returned: 0 in 0.315s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:34 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Lock "cinder-quobyte-7d2c6f15-5c32-43ca-ba61-0d03114119da" released by "delete_volume" :: held 0.968s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Created reservations ['ca74e647-c2b3-426c-bba9-b800b2cb7cef', '19aa3f46-bd77-4d6c-a796-9936738892a8', 'a07ae403-6f74-4e1a-b62c-81a63e7b89c8', '48aa604c-11f3-41ba-a6e1-1f76c59dcbc7'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:35 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:35 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:35 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a 1G" returned: 0 in 0.623s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e24be3-71fb-4e9b-89f9-dce69658af44 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:35 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e24be3-71fb-4e9b-89f9-dce69658af44 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a Sep 28 21:55:35 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:35 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.287s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Deleted volume successfully. Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-a60cfad4-93c4-4923-b464-63a9eabfbf32 tempest-ProjectReaderTests-346779204 None] Lock "cinder-7d2c6f15-5c32-43ca-ba61-0d03114119da-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:35 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e24be3-71fb-4e9b-89f9-dce69658af44 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a" returned: 0 in 0.340s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:35 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a is being set with open permissions: ugo+rw Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:35 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a Sep 28 21:55:35 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:35 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a" returned: 0 in 0.289s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:35 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.info Sep 28 21:55:35 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:36 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.info" returned: 0 in 0.315s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:36 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.info is being set with open permissions: ugo+rw Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:36 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.info Sep 28 21:55:36 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:36 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.info" returned: 0 in 0.394s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.955s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Creating offline snapshot 93486896-7b46-4a5f-b312-55e399e16f39 of volume 11f29596-33d8-4aba-864e-ad001fd3a298 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cd1122-95db-4564-a6be-7fd62993b3b7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:36 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1b6753c8-8e90-44b3-b80a-688ac4d72f15 tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Flow 'volume_create_manager' (8366d273-d0bf-4613-a69c-bbc0de486904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54619ec-36be-44c2-9095-f3aa0540e0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54619ec-36be-44c2-9095-f3aa0540e0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11673676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66dc85d-3f04-46ad-b105-28d501c30d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad395cf5ca714c14bc8594e73f63af51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:37Z,use_quota=True,user_id='d9ba9d7d621549a7a6f6a9bf5b3b5c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ff6af1-8fdc-4080-9439-d3b6180c534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ff6af1-8fdc-4080-9439-d3b6180c534e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcc712f-0858-4a08-92db-667ebe799501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcc712f-0858-4a08-92db-667ebe799501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66dc85d-3f04-46ad-b105-28d501c30d2e', 'volume_name': 'volume-c66dc85d-3f04-46ad-b105-28d501c30d2e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764710ed-7d31-4fc2-ba0e-22288a48c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764710ed-7d31-4fc2-ba0e-22288a48c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7745f138-c0e8-4bc8-be70-3084174358ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:36 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Volume c66dc85d-3f04-46ad-b105-28d501c30d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66dc85d-3f04-46ad-b105-28d501c30d2e', 'volume_size': 1} Sep 28 21:55:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:36 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 Sep 28 21:55:36 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:37 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298" returned: 0 in 0.386s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:37 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 1G Sep 28 21:55:37 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-aad39a3b-eeea-4e11-8ce0-277ec125170a-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Lock "cinder-aad39a3b-eeea-4e11-8ce0-277ec125170a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-55e24be3-71fb-4e9b-89f9-dce69658af44" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-55e24be3-71fb-4e9b-89f9-dce69658af44" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-aad39a3b-eeea-4e11-8ce0-277ec125170a" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-aad39a3b-eeea-4e11-8ce0-277ec125170a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot aad39a3b-eeea-4e11-8ce0-277ec125170a of volume 55e24be3-71fb-4e9b-89f9-dce69658af44 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c1d49-b629-4347-8bb9-d75078ea7339]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:37 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a Sep 28 21:55:37 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Flow 'volume_create_manager' (0d3754ae-5e84-466d-99a1-cc4e3478ad5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba54fa9-d7fe-4225-906f-fb2fe3f7db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba54fa9-d7fe-4225-906f-fb2fe3f7db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-246315517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3610a0a-cead-4dc7-a2c0-59e423928fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1342c32ee444189bb91551a6db4888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:38Z,use_quota=True,user_id='4d7bc2cb706d4637aeed24e64de267df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:37 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d008024-d9bf-43cf-ba4f-2c3161ebf517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d008024-d9bf-43cf-ba4f-2c3161ebf517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6444b559-a49b-4f88-9650-82d29325d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6444b559-a49b-4f88-9650-82d29325d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3610a0a-cead-4dc7-a2c0-59e423928fdb', 'volume_name': 'volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ff8cb9-2c99-4a4f-af4e-dfe7cad963bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ff8cb9-2c99-4a4f-af4e-dfe7cad963bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86795479-fe35-47e9-b76d-4bc25e190d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:37 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Volume b3610a0a-cead-4dc7-a2c0-59e423928fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb', 'volume_size': 1} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 1G" returned: 0 in 0.566s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f29596-33d8-4aba-864e-ad001fd3a298 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:37 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f29596-33d8-4aba-864e-ad001fd3a298 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 Sep 28 21:55:37 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:37 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a" returned: 0 in 0.440s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55e24be3-71fb-4e9b-89f9-dce69658af44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[222d63cd-0053-4d4e-9558-08f0a9fdcf65]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:38 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 Sep 28 21:55:38 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:38 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f29596-33d8-4aba-864e-ad001fd3a298 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39" returned: 0 in 0.320s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:38 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 is being set with open permissions: ugo+rw Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:38 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 Sep 28 21:55:38 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:38 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44" returned: 0 in 0.366s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:38 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a Sep 28 21:55:38 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:38 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:38 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.info Sep 28 21:55:38 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:38 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.info" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:38 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.info is being set with open permissions: ugo+rw Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:38 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a" returned: 0 in 0.340s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:38 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.info Sep 28 21:55:38 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:38 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a Sep 28 21:55:38 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:38 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44.aad39a3b-eeea-4e11-8ce0-277ec125170a" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:38 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.info" returned: 0 in 0.273s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11673676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66dc85d-3f04-46ad-b105-28d501c30d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad395cf5ca714c14bc8594e73f63af51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:37Z,use_quota=True,user_id='d9ba9d7d621549a7a6f6a9bf5b3b5c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Creating volume c66dc85d-3f04-46ad-b105-28d501c30d2e {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:38 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:38 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e 1073741824 Sep 28 21:55:38 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-aad39a3b-eeea-4e11-8ce0-277ec125170a" released by "_delete_snapshot" :: held 1.590s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-55e24be3-71fb-4e9b-89f9-dce69658af44" released by "delete_snapshot" :: held 1.620s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:38 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9f600179-c6d7-4322-af59-d1c2d94bac22 tempest-ProjectReaderTests-451017063 None] Create snapshot completed successfully Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Created reservations ['8cb8540c-741a-497f-b0e8-05f9bd7c3ab9', 'd403dc6c-926f-4b61-af17-26f1c9baf442', '48db544b-ac08-44b6-9681-e1dbdd0be340', 'b2ecf3f3-b289-4579-a6d6-9d12bb0d38ab'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-76aa626f-c0b9-45f7-829f-d520dcc0ea7b tempest-ProjectMemberTests-149632569 None] Lock "cinder-aad39a3b-eeea-4e11-8ce0-277ec125170a-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:39 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e 1073741824" returned: 0 in 0.410s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:39 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e Sep 28 21:55:39 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-55e24be3-71fb-4e9b-89f9-dce69658af44-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Lock "cinder-55e24be3-71fb-4e9b-89f9-dce69658af44-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-55e24be3-71fb-4e9b-89f9-dce69658af44" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-55e24be3-71fb-4e9b-89f9-dce69658af44" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ff960-d486-4756-ada8-2257cd05fd9c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:39 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e" returned: 0 in 0.264s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.873s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-246315517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3610a0a-cead-4dc7-a2c0-59e423928fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1342c32ee444189bb91551a6db4888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:38Z,use_quota=True,user_id='4d7bc2cb706d4637aeed24e64de267df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Creating volume b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:39 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:39 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb 1073741824 Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7745f138-c0e8-4bc8-be70-3084174358ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66dc85d-3f04-46ad-b105-28d501c30d2e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:39 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d87c931-d5cf-4375-8f27-3d3d516c9613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:39 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 Sep 28 21:55:39 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:39 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Volume volume-c66dc85d-3f04-46ad-b105-28d501c30d2e (c66dc85d-3f04-46ad-b105-28d501c30d2e): created successfully Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d87c931-d5cf-4375-8f27-3d3d516c9613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Flow 'volume_create_manager' (8366d273-d0bf-4613-a69c-bbc0de486904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8671343d-ec4a-431e-9e47-8d37c5dda7c7 tempest-ProjectReaderTests-346779204 None] Created volume successfully. Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Acquiring lock "cinder-c66dc85d-3f04-46ad-b105-28d501c30d2e-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Lock "cinder-c66dc85d-3f04-46ad-b105-28d501c30d2e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:39 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44" returned: 0 in 0.443s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Acquiring lock "cinder-quobyte-c66dc85d-3f04-46ad-b105-28d501c30d2e" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:40 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44 Sep 28 21:55:40 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Lock "cinder-quobyte-c66dc85d-3f04-46ad-b105-28d501c30d2e" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4434b1f7-75b9-46ff-bc55-15642d81d3c7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:40 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e Sep 28 21:55:40 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-93486896-7b46-4a5f-b312-55e399e16f39-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:40 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb 1073741824" returned: 0 in 0.604s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Lock "cinder-93486896-7b46-4a5f-b312-55e399e16f39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-11f29596-33d8-4aba-864e-ad001fd3a298" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-11f29596-33d8-4aba-864e-ad001fd3a298" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-93486896-7b46-4a5f-b312-55e399e16f39" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-93486896-7b46-4a5f-b312-55e399e16f39" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Deleting offline snapshot 93486896-7b46-4a5f-b312-55e399e16f39 of volume 11f29596-33d8-4aba-864e-ad001fd3a298 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:55:40 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:40 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb Sep 28 21:55:40 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] snapshot_file for this snap is: volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-55e24be3-71fb-4e9b-89f9-dce69658af44" returned: 0 in 0.368s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[85abf520-b5f8-4943-aaff-f76361f7371c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-55e24be3-71fb-4e9b-89f9-dce69658af44" released by "delete_volume" :: held 0.886s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Created reservations ['e0adae5d-6051-42f6-8b5b-6adb9a5b939f', 'e6458ffd-dd2a-49e6-9bd9-b01a751863f7', '395554a0-e243-40eb-8a64-15f3690a816c', 'a9bfdca3-bc46-43c4-b49d-303dcdb7c613'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:40 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e" returned: 0 in 0.424s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:40 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 Sep 28 21:55:40 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:40 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e Sep 28 21:55:40 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:40 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb" returned: 0 in 0.328s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:40 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:40 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86795479-fe35-47e9-b76d-4bc25e190d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8383220-0305-4089-ad98-4fe208679424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:40 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Volume volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb (b3610a0a-cead-4dc7-a2c0-59e423928fdb): created successfully Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8383220-0305-4089-ad98-4fe208679424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Flow 'volume_create_manager' (0d3754ae-5e84-466d-99a1-cc4e3478ad5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:40 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d2930124-ba61-4e67-8bc7-e49625090589 tempest-SnapshotDependencyTests-1321409833 None] Created volume successfully. Sep 28 21:55:40 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39" returned: 0 in 0.503s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11f29596-33d8-4aba-864e-ad001fd3a298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:55:40 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-c66dc85d-3f04-46ad-b105-28d501c30d2e" returned: 0 in 0.408s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4b9d31-1fda-487d-90b0-9a81da37f408]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Lock "cinder-quobyte-c66dc85d-3f04-46ad-b105-28d501c30d2e" released by "delete_volume" :: held 0.908s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:40 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.343s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:40 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:55:40 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-0f31fa46-f434-444f-8214-0ea768a68c15 tempest-ProjectMemberTests-149632569 None] Lock "cinder-55e24be3-71fb-4e9b-89f9-dce69658af44-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Created reservations ['6e5c24a4-4228-4496-8a6a-2727955c4ce4', '657c1614-7255-406f-855d-02af28ecd29d', '775f9b3e-01d8-4881-95ad-b6bef522e01b', '6fbfd4c3-b82b-4688-9f8b-0b1f49a90148'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:41 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 Sep 28 21:55:41 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:41 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:41 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (bb650f79-6315-4ebb-9629-c4d7362ba687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612f7182-2d06-47be-b27a-a9806d5f2b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612f7182-2d06-47be-b27a-a9806d5f2b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586674288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a32eeb-eb7c-43d1-9d34-d53581bc5694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:41Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1e42e4-418d-420e-acdc-867a2a027a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1e42e4-418d-420e-acdc-867a2a027a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a319801-bc67-4b51-a97b-3ac228a0ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a319801-bc67-4b51-a97b-3ac228a0ace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a32eeb-eb7c-43d1-9d34-d53581bc5694', 'volume_name': 'volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e59604d-ac34-4aaa-a7a0-1ffba34af1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e59604d-ac34-4aaa-a7a0-1ffba34af1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4aa019-139b-4a86-ba90-1db669111d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Volume a3a32eeb-eb7c-43d1-9d34-d53581bc5694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694', 'volume_size': 1} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586674288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a32eeb-eb7c-43d1-9d34-d53581bc5694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:41Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Creating volume a3a32eeb-eb7c-43d1-9d34-d53581bc5694 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:41 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298" returned: 0 in 0.537s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:41 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:41 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 1073741824 Sep 28 21:55:41 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.329s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:41 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 Sep 28 21:55:41 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:41 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Deleted volume successfully. Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6151f75d-fed3-4758-896b-ff332bde3b30 tempest-ProjectReaderTests-346779204 None] Lock "cinder-c66dc85d-3f04-46ad-b105-28d501c30d2e-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Flow 'volume_create_manager' (6ca0fa65-f22c-4371-b7ad-484591088cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70df5436-1b13-4c05-9146-86dc3cd67fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70df5436-1b13-4c05-9146-86dc3cd67fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19154336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb063e0-bdaf-421a-a16f-68e16a719185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad395cf5ca714c14bc8594e73f63af51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:42Z,use_quota=True,user_id='d9ba9d7d621549a7a6f6a9bf5b3b5c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfed6617-dc8a-4fc6-b50f-253309f17150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfed6617-dc8a-4fc6-b50f-253309f17150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637d755c-2c11-40f8-896f-7a617067ba7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637d755c-2c11-40f8-896f-7a617067ba7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb063e0-bdaf-421a-a16f-68e16a719185', 'volume_name': 'volume-6eb063e0-bdaf-421a-a16f-68e16a719185', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa9384c-f1b2-41c1-8502-38c068740897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa9384c-f1b2-41c1-8502-38c068740897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350eb39c-2c57-42b5-a600-6a5b7e580ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:41 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Volume 6eb063e0-bdaf-421a-a16f-68e16a719185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb063e0-bdaf-421a-a16f-68e16a719185', 'volume_size': 1} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:41 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39" returned: 0 in 0.449s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:41 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39 Sep 28 21:55:41 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:42 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 1073741824" returned: 0 in 0.585s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:42 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 Sep 28 21:55:42 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:42 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298.93486896-7b46-4a5f-b312-55e399e16f39" returned: 0 in 0.293s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-93486896-7b46-4a5f-b312-55e399e16f39" released by "_delete_snapshot" :: held 1.908s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-11f29596-33d8-4aba-864e-ad001fd3a298" released by "delete_snapshot" :: held 1.949s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Created reservations ['66fab1fc-0845-4928-95b5-1e27eb766d61', 'dc9a2943-f332-429f-86ea-ac772e5f5274', '774047dc-88b0-48c4-abe4-15916050c5e6', '6a77144b-8dbb-42e8-8e0f-6abc1925032e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Delete snapshot completed successfully. Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f2b8ecfe-fe3f-40e5-bc80-a7cc755030eb tempest-ProjectReaderTests-451017063 None] Lock "cinder-93486896-7b46-4a5f-b312-55e399e16f39-delete_snapshot" released by "delete_snapshot" :: held 2.095s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:42 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" returned: 0 in 0.319s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19154336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb063e0-bdaf-421a-a16f-68e16a719185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad395cf5ca714c14bc8594e73f63af51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:42Z,use_quota=True,user_id='d9ba9d7d621549a7a6f6a9bf5b3b5c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Creating volume 6eb063e0-bdaf-421a-a16f-68e16a719185 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:42 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4aa019-139b-4a86-ba90-1db669111d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:42 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 1073741824 Sep 28 21:55:42 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ebee6b-4a31-4d66-8eff-4900ad4b61cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-11f29596-33d8-4aba-864e-ad001fd3a298-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:42 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Volume volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 (a3a32eeb-eb7c-43d1-9d34-d53581bc5694): created successfully Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ebee6b-4a31-4d66-8eff-4900ad4b61cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (bb650f79-6315-4ebb-9629-c4d7362ba687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Lock "cinder-11f29596-33d8-4aba-864e-ad001fd3a298-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3d5f21cd-320b-4471-93d5-926028fecd78 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-11f29596-33d8-4aba-864e-ad001fd3a298" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-11f29596-33d8-4aba-864e-ad001fd3a298" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ce027d-cc0f-476b-a9d8-028e0a3846f0]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:42 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 Sep 28 21:55:42 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:42 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 1073741824" returned: 0 in 0.424s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:42 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 Sep 28 21:55:42 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:42 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298" returned: 0 in 0.382s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:42 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298 Sep 28 21:55:42 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:43 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.948s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350eb39c-2c57-42b5-a600-6a5b7e580ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb063e0-bdaf-421a-a16f-68e16a719185', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8df83a-68ff-40fd-a57f-298db20e0643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Creating offline snapshot e4c1aa22-e509-4318-ab57-b1b3f80eeb7e of volume b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e64d62-fa88-46ee-9e80-cd4557a08829]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:43 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Volume volume-6eb063e0-bdaf-421a-a16f-68e16a719185 (6eb063e0-bdaf-421a-a16f-68e16a719185): created successfully Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8df83a-68ff-40fd-a57f-298db20e0643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:43 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Flow 'volume_create_manager' (6ca0fa65-f22c-4371-b7ad-484591088cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-11f29596-33d8-4aba-864e-ad001fd3a298" returned: 0 in 0.268s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-11f29596-33d8-4aba-864e-ad001fd3a298" released by "delete_volume" :: held 0.727s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:43 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a7fcfe6c-f4a4-4233-a3ae-dd22c66010f7 tempest-ProjectReaderTests-346779204 None] Created volume successfully. Sep 28 21:55:43 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb Sep 28 21:55:43 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Created reservations ['d9c7dff3-0ad4-4e2d-81f1-f57fa1b9cdca', '95639d27-8145-4eea-8c22-66aae889bc0a', '07dbf65d-5ffa-4981-a138-6966f1682323', 'a0796226-e339-44a9-b4b6-9c9001812911'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:43 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:43 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:43 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb" returned: 0 in 0.420s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:43 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e 1G Sep 28 21:55:43 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:43 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.299s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:43 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Deleted volume successfully. Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-5577ef32-4b71-4726-96c3-b1ea9dbe03d2 tempest-ProjectReaderTests-451017063 None] Lock "cinder-11f29596-33d8-4aba-864e-ad001fd3a298-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Acquiring lock "cinder-6eb063e0-bdaf-421a-a16f-68e16a719185-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Lock "cinder-6eb063e0-bdaf-421a-a16f-68e16a719185-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Acquiring lock "cinder-quobyte-6eb063e0-bdaf-421a-a16f-68e16a719185" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Lock "cinder-quobyte-6eb063e0-bdaf-421a-a16f-68e16a719185" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a953f08-9edf-4778-9c3c-a9cac7d34c5a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:44 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 Sep 28 21:55:44 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:44 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e 1G" returned: 0 in 0.531s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:44 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e Sep 28 21:55:44 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (c3093c75-459d-47d7-951b-a024eec1f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137bdf91-519c-4841-aa7d-bf094078b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137bdf91-519c-4841-aa7d-bf094078b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1922536410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=056b50b8-d5ee-458c-95e6-ce0795934967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:44Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b104b3-04d7-4a4d-97b2-ca9b2c1016e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b104b3-04d7-4a4d-97b2-ca9b2c1016e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d38e6d4-8831-4da5-a9c0-abc6cfa29417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d38e6d4-8831-4da5-a9c0-abc6cfa29417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '056b50b8-d5ee-458c-95e6-ce0795934967', 'volume_name': 'volume-056b50b8-d5ee-458c-95e6-ce0795934967', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8cef78-6ceb-42d7-9e81-21ed5fe67617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8cef78-6ceb-42d7-9e81-21ed5fe67617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaaf020-6e48-461f-8f12-e3f634ade5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:44 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Volume 056b50b8-d5ee-458c-95e6-ce0795934967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-056b50b8-d5ee-458c-95e6-ce0795934967', 'volume_size': 1} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:44 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185" returned: 0 in 0.388s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:44 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185 Sep 28 21:55:44 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:44 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" returned: 0 in 0.316s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:44 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e is being set with open permissions: ugo+rw Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:44 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e Sep 28 21:55:44 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:44 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-6eb063e0-bdaf-421a-a16f-68e16a719185" returned: 0 in 0.259s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Lock "cinder-quobyte-6eb063e0-bdaf-421a-a16f-68e16a719185" released by "delete_volume" :: held 0.700s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Created reservations ['980e16ae-87ef-42e1-9d8f-a32526fd4cec', '01eb6903-5d58-47b8-8999-8ddfe06ab9ad', 'cb30d62d-4873-4a5d-99b8-d8d30103f226', 'f541fa0c-432a-4f41-8ecc-465743c85249'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:44 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" returned: 0 in 0.269s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:44 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:44 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:44 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.info Sep 28 21:55:44 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:44 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:45 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Deleted volume successfully. Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce1af53e-53f4-4af3-9bf0-27fa182524bc tempest-ProjectReaderTests-346779204 None] Lock "cinder-6eb063e0-bdaf-421a-a16f-68e16a719185-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:45 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.info" returned: 0 in 0.287s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:45 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.info is being set with open permissions: ugo+rw Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:45 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.info Sep 28 21:55:45 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:45 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.info" returned: 0 in 0.260s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.778s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Creating offline snapshot 5f3506df-964d-40ca-9693-714360591662 of volume a3a32eeb-eb7c-43d1-9d34-d53581bc5694 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:55:45 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-09eedc33-58a0-42fc-a7a0-c05c67a3789c tempest-SnapshotDependencyTests-1321409833 None] Create snapshot completed successfully Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3b2c8d-ec5e-4dc9-b679-c31807d224a5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:45 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 Sep 28 21:55:45 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:45 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" returned: 0 in 0.372s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:45 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 1G Sep 28 21:55:45 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:46 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 1G" returned: 0 in 0.456s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:46 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 Sep 28 21:55:46 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:46 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662" returned: 0 in 0.342s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:46 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 is being set with open permissions: ugo+rw Sep 28 21:55:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:46 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 Sep 28 21:55:46 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:46 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662" returned: 0 in 0.312s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:46 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.info Sep 28 21:55:46 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Flow 'volume_create_manager' (8227f445-8258-4f4f-afba-58442aa3a3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec32086-362f-4a47-a4cc-a8375de80b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec32086-362f-4a47-a4cc-a8375de80b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b1212-2c62-4409-b86c-8824316c16d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1342c32ee444189bb91551a6db4888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4c1aa22-e509-4318-ab57-b1b3f80eeb7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:47Z,use_quota=True,user_id='4d7bc2cb706d4637aeed24e64de267df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60809266-e739-4bff-933f-4d574dee4f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60809266-e739-4bff-933f-4d574dee4f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19262da9-2347-48ec-b917-84337e04ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19262da9-2347-48ec-b917-84337e04ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '188b1212-2c62-4409-b86c-8824316c16d7', 'volume_name': 'volume-188b1212-2c62-4409-b86c-8824316c16d7', 'volume_size': 1, 'snapshot_id': 'e4c1aa22-e509-4318-ab57-b1b3f80eeb7e'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb47ec87-7e1c-41ae-be29-c15e20fc9b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb47ec87-7e1c-41ae-be29-c15e20fc9b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dfa76e-ec8c-4536-b53c-f3507ac2e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:47 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Volume 188b1212-2c62-4409-b86c-8824316c16d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-188b1212-2c62-4409-b86c-8824316c16d7', 'volume_size': 1, 'snapshot_id': 'e4c1aa22-e509-4318-ab57-b1b3f80eeb7e'} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:47 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.info" returned: 0 in 0.274s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:47 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.info is being set with open permissions: ugo+rw Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:47 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.info Sep 28 21:55:47 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:47 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.info" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.202s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1922536410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=056b50b8-d5ee-458c-95e6-ce0795934967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:44Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Creating volume 056b50b8-d5ee-458c-95e6-ce0795934967 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:47 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:47 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 1073741824 Sep 28 21:55:47 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-5c4f041f-ac3b-4257-bb0c-7a0290937f99 tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-5f3506df-964d-40ca-9693-714360591662-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Lock "cinder-5f3506df-964d-40ca-9693-714360591662-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-5f3506df-964d-40ca-9693-714360591662" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-5f3506df-964d-40ca-9693-714360591662" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot 5f3506df-964d-40ca-9693-714360591662 of volume a3a32eeb-eb7c-43d1-9d34-d53581bc5694 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4a0ee0-eeb4-4c7a-8c58-ea5a8579c686]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:47 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 Sep 28 21:55:47 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:47 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 1073741824" returned: 0 in 0.525s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:48 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 Sep 28 21:55:48 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:48 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662" returned: 0 in 0.382s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd20ab48-7512-4ddf-8bd0-d70681581fd5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:48 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967" returned: 0 in 0.271s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.149s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-quobyte-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e-188b1212-2c62-4409-b86c-8824316c16d7" by "_create_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaaf020-6e48-461f-8f12-e3f634ade5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-056b50b8-d5ee-458c-95e6-ce0795934967', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770cb220-d62c-40e8-8cfe-7b69bb353d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e-188b1212-2c62-4409-b86c-8824316c16d7" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Creating volume 188b1212-2c62-4409-b86c-8824316c16d7 from snapshot e4c1aa22-e509-4318-ab57-b1b3f80eeb7e {{(pid=86489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-quobyte-188b1212-2c62-4409-b86c-8824316c16d7" by "_copy_volume_from_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:48 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Volume volume-056b50b8-d5ee-458c-95e6-ce0795934967 (056b50b8-d5ee-458c-95e6-ce0795934967): created successfully Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770cb220-d62c-40e8-8cfe-7b69bb353d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (c3093c75-459d-47d7-951b-a024eec1f05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-188b1212-2c62-4409-b86c-8824316c16d7" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] snapshot: e4c1aa22-e509-4318-ab57-b1b3f80eeb7e, volume: 188b1212-2c62-4409-b86c-8824316c16d7, {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 21:55:48 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c75ef14a-c1f6-4482-8bdb-05d3720f2c30 tempest-ProjectReaderTests-451017063 None] Created volume successfully. Sep 28 21:55:48 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 Sep 28 21:55:48 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0853f800-807e-46d2-a342-f0d12b80a401]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:48 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e Sep 28 21:55:48 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:48 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" returned: 0 in 0.383s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:48 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 Sep 28 21:55:48 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:48 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" returned: 0 in 0.363s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e463b3-cfd9-4447-9377-833bd82228e6]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:48 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb Sep 28 21:55:48 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:49 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662" returned: 0 in 0.373s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:49 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662 Sep 28 21:55:49 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:49 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb" returned: 0 in 0.375s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Creating direct copy from snapshot {{(pid=86489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG cinder.utils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Path /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 not found in is_blk_device check {{(pid=86489) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:49 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 Sep 28 21:55:49 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:49 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694.5f3506df-964d-40ca-9693-714360591662" returned: 0 in 0.253s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-5f3506df-964d-40ca-9693-714360591662" released by "_delete_snapshot" :: held 1.528s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" released by "delete_snapshot" :: held 1.555s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Created reservations ['37947f71-fe22-439a-a1f4-4ac43c9f8e69', '4b938ee0-8b82-4f05-a4eb-3e914dffe66b', 'ae43da5d-e5ed-4a90-bed4-2f7a8d22f6b8', 'f762678a-7de7-4756-81e9-6861dfae73d8'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:49 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e2ca8b85-90d9-415c-8bf5-53d52c515ad6 tempest-ProjectMemberTests-149632569 None] Lock "cinder-5f3506df-964d-40ca-9693-714360591662-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-a3a32eeb-eb7c-43d1-9d34-d53581bc5694-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Lock "cinder-a3a32eeb-eb7c-43d1-9d34-d53581bc5694-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:50 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" acquired by "delete_volume" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[90637227-339a-44d8-8b49-e777acdad189]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:50 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 Sep 28 21:55:50 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:50 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" returned: 0 in 0.533s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:50 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694 Sep 28 21:55:50 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:51 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" returned: 0 in 0.356s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-a3a32eeb-eb7c-43d1-9d34-d53581bc5694" released by "delete_volume" :: held 1.045s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Created reservations ['9b463860-5cf2-4928-806d-d1fa7f8a054c', '6e364bd9-228b-4a96-a2d1-51310d53a2ac', 'bf9787b4-e262-4966-a8f3-28822fdbf6f5', 'fa6349c5-8c86-4ef8-9116-c7d42e52178f'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:51 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:55:51 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:51 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.344s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:55:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:55:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-df421df4-e075-418a-b01c-5e5f9504a98c tempest-ProjectMemberTests-149632569 None] Lock "cinder-a3a32eeb-eb7c-43d1-9d34-d53581bc5694-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (ee279977-0771-492b-b464-095843315e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691e8bd9-585f-4f00-8c66-294d5087939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691e8bd9-585f-4f00-8c66-294d5087939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487167148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50adffce-fa22-4e84-8872-b02dea997650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:53Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582f66d8-13ff-4d31-b206-90dd009e37f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582f66d8-13ff-4d31-b206-90dd009e37f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab65075-b30b-4b8b-bd77-562e35f2d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab65075-b30b-4b8b-bd77-562e35f2d27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50adffce-fa22-4e84-8872-b02dea997650', 'volume_name': 'volume-50adffce-fa22-4e84-8872-b02dea997650', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba757cc9-0ce4-46a8-b162-f92de0639475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba757cc9-0ce4-46a8-b162-f92de0639475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8576233f-1844-404f-9a3f-acbcd769878b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:53 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Volume 50adffce-fa22-4e84-8872-b02dea997650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50adffce-fa22-4e84-8872-b02dea997650', 'volume_size': 1} Sep 28 21:55:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7" returned: 0 in 6.622s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:55 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Image conversion details: src /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 {{(pid=86489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 21:55:55 devstack cinder-volume[86489]: INFO cinder.image.image_utils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Converted 1024.00 MB image at 154.63 MB/s Sep 28 21:55:55 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 is being set with open permissions: ugo+rw Sep 28 21:55:55 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:55 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 Sep 28 21:55:55 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:56 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7" returned: 0 in 0.238s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-188b1212-2c62-4409-b86c-8824316c16d7" released by "_copy_volume_from_snapshot" :: held 7.707s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e-188b1212-2c62-4409-b86c-8824316c16d7" released by "_create_volume_from_snapshot" :: held 7.780s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.816s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.512s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Creating offline snapshot 2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 of volume 056b50b8-d5ee-458c-95e6-ce0795934967 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dfa76e-ec8c-4536-b53c-f3507ac2e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188b1212-2c62-4409-b86c-8824316c16d7', 'volume_size': 1, 'snapshot_id': 'e4c1aa22-e509-4318-ab57-b1b3f80eeb7e'}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce5a0c7-aa42-4608-b111-58273fb318eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2290af4a-1a34-435c-92bc-1602108cef29]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:56 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Volume volume-188b1212-2c62-4409-b86c-8824316c16d7 (188b1212-2c62-4409-b86c-8824316c16d7): created successfully Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce5a0c7-aa42-4608-b111-58273fb318eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Flow 'volume_create_manager' (8227f445-8258-4f4f-afba-58442aa3a3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ce7c2e9c-106f-4a2c-8d39-e4d2f21ff72e tempest-SnapshotDependencyTests-1321409833 None] Created volume successfully. Sep 28 21:55:56 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 Sep 28 21:55:56 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:56 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967" returned: 0 in 0.357s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:56 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 1G Sep 28 21:55:56 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-quobyte-b3610a0a-cead-4dc7-a2c0-59e423928fdb" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-b3610a0a-cead-4dc7-a2c0-59e423928fdb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-quobyte-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Deleting offline snapshot e4c1aa22-e509-4318-ab57-b1b3f80eeb7e of volume b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] snapshot_file for this snap is: volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccaf3c7-486e-4c0a-a12c-1b55a99de588]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:56 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 1G" returned: 0 in 0.443s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-056b50b8-d5ee-458c-95e6-ce0795934967 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:56 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-056b50b8-d5ee-458c-95e6-ce0795934967 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 Sep 28 21:55:56 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:57 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e Sep 28 21:55:57 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:57 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-056b50b8-d5ee-458c-95e6-ce0795934967 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0" returned: 0 in 0.292s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:57 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 is being set with open permissions: ugo+rw Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:57 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 Sep 28 21:55:57 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:57 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" returned: 0 in 0.374s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[147eef44-27c9-43b5-8a06-be4e79c4b674]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:57 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb Sep 28 21:55:57 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:57 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:57 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.info Sep 28 21:55:57 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:57 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.info" returned: 0 in 0.251s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:57 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.info is being set with open permissions: ugo+rw Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:57 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.info Sep 28 21:55:57 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:57 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb" returned: 0 in 0.545s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:57 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e Sep 28 21:55:57 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:58 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.info" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.796s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487167148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50adffce-fa22-4e84-8872-b02dea997650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:55:53Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Creating volume 50adffce-fa22-4e84-8872-b02dea997650 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:55:58 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:58 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 1073741824 Sep 28 21:55:58 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e10ae8be-7761-4231-8ca3-888ea10e489c tempest-ProjectReaderTests-451017063 None] Create snapshot completed successfully Sep 28 21:55:58 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" returned: 0 in 0.339s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:58 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e Sep 28 21:55:58 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:58 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb.e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" returned: 0 in 0.267s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:58 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 1073741824" returned: 0 in 0.421s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e" released by "_delete_snapshot" :: held 1.642s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-b3610a0a-cead-4dc7-a2c0-59e423928fdb" released by "delete_snapshot" :: held 1.668s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:58 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 Sep 28 21:55:58 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Created reservations ['c996fe88-de31-49a3-bb03-4ad7c2fb7e65', '83593c22-6f67-4544-a54c-01ae94ec5bb3', '5148e26d-70d4-4fa0-bba9-e2e96562bbee', 'cc091b1a-e483-4869-a852-e35546b10b73'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Delete snapshot completed successfully. Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-4a450dbb-8641-4bce-adfb-38782c7c0b46 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-e4c1aa22-e509-4318-ab57-b1b3f80eeb7e-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:58 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8576233f-1844-404f-9a3f-acbcd769878b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50adffce-fa22-4e84-8872-b02dea997650', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69c01e3-e00b-47ba-8284-53ba2711c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:55:58 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Volume volume-50adffce-fa22-4e84-8872-b02dea997650 (50adffce-fa22-4e84-8872-b02dea997650): created successfully Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69c01e3-e00b-47ba-8284-53ba2711c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:55:58 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (ee279977-0771-492b-b464-095843315e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:55:58 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3c15c2a1-0ebb-446f-b86e-fc3b43a59f15 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-b3610a0a-cead-4dc7-a2c0-59e423928fdb-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-b3610a0a-cead-4dc7-a2c0-59e423928fdb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-quobyte-b3610a0a-cead-4dc7-a2c0-59e423928fdb" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-b3610a0a-cead-4dc7-a2c0-59e423928fdb" acquired by "delete_volume" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d18069d-0d81-4b88-9243-a775fc26ff2c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-056b50b8-d5ee-458c-95e6-ce0795934967" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-056b50b8-d5ee-458c-95e6-ce0795934967" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Deleting offline snapshot 2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 of volume 056b50b8-d5ee-458c-95e6-ce0795934967 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] snapshot_file for this snap is: volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9227ca-382e-48ab-a915-be381b3e5c66]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:59 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb Sep 28 21:55:59 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:59 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 Sep 28 21:55:59 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:59 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb" returned: 0 in 0.398s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:59 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb Sep 28 21:55:59 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:59 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0" returned: 0 in 0.397s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-056b50b8-d5ee-458c-95e6-ce0795934967(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de31489-5c7a-411d-9b45-6d6ad40e2e7b]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:59 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 Sep 28 21:55:59 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Creating offline snapshot 4f236f64-c339-41e5-ae09-adc5ab0cda0b of volume 50adffce-fa22-4e84-8872-b02dea997650 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:55:59 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-b3610a0a-cead-4dc7-a2c0-59e423928fdb" returned: 0 in 0.313s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af4c184-1d0a-4a27-a082-b568cb9697e8]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-b3610a0a-cead-4dc7-a2c0-59e423928fdb" released by "delete_volume" :: held 0.796s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Created reservations ['61d97aff-3147-4073-ae74-2a7f5e751eb0', 'fcc77254-2ee0-4e3d-857b-75a4c63eaf09', 'dbf249df-06f0-4a9b-b1e5-51336b9fba09', '84eab472-ed35-4128-a0cb-0f537b5b530e'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:55:59 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 Sep 28 21:55:59 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:55:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:00 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:00 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:00 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967" returned: 0 in 0.419s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:00 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 Sep 28 21:56:00 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-188b1212-2c62-4409-b86c-8824316c16d7-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-188b1212-2c62-4409-b86c-8824316c16d7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "cinder-quobyte-188b1212-2c62-4409-b86c-8824316c16d7" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:00 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:00 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-188b1212-2c62-4409-b86c-8824316c16d7" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650" returned: 0 in 0.473s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.339s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[66052cf0-cedc-4880-9867-9f908a00fb20]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Deleted volume successfully. Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:00 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b 1G Sep 28 21:56:00 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-13ab938f-238f-4434-80e1-342e96c9bf95 tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-b3610a0a-cead-4dc7-a2c0-59e423928fdb-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:00 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 Sep 28 21:56:00 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:00 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0" returned: 0 in 0.418s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:00 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0 Sep 28 21:56:00 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:00 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7" returned: 0 in 0.416s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:00 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b 1G" returned: 0 in 0.467s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50adffce-fa22-4e84-8872-b02dea997650 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:00 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967.2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0" returned: 0 in 0.301s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:00 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7 Sep 28 21:56:00 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:00 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50adffce-fa22-4e84-8872-b02dea997650 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b Sep 28 21:56:00 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0" released by "_delete_snapshot" :: held 1.655s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-056b50b8-d5ee-458c-95e6-ce0795934967" released by "delete_snapshot" :: held 1.673s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Created reservations ['067cb6b3-74f7-4cb9-87bb-7aaa3f5dce48', '57dc69fa-5ea4-4cef-8c9d-2ab248d616e7', '338292d1-63ff-4296-8845-77fe57d14438', '19f74f26-ab17-4a07-bdd2-1aaef44d3923'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Delete snapshot completed successfully. Sep 28 21:56:00 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-afbf262e-9b8c-4359-8e07-033a62ad49c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-2aa9c3f6-75cc-4f2d-9679-9fcd0e15daa0-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:01 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-188b1212-2c62-4409-b86c-8824316c16d7" returned: 0 in 0.271s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-quobyte-188b1212-2c62-4409-b86c-8824316c16d7" released by "delete_volume" :: held 0.751s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Created reservations ['200cc794-9dc0-4533-95c7-2165bb109d2f', 'f255c132-feb0-4776-9ebf-48534ec392a6', '6e952a1e-c2e1-45eb-9687-9cca92ca88e7', '4c7ce863-5c07-46a7-b148-86fd5658efd8'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:01 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50adffce-fa22-4e84-8872-b02dea997650 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b" returned: 0 in 0.321s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:01 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b is being set with open permissions: ugo+rw Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:01 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b Sep 28 21:56:01 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:01 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:01 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-056b50b8-d5ee-458c-95e6-ce0795934967-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Lock "cinder-056b50b8-d5ee-458c-95e6-ce0795934967-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:01 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b" returned: 0 in 0.303s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-056b50b8-d5ee-458c-95e6-ce0795934967" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-056b50b8-d5ee-458c-95e6-ce0795934967" acquired by "delete_volume" :: waited 0.043s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:01 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.info Sep 28 21:56:01 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:01 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.333s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:01 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Deleted volume successfully. Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd071210-effb-43a4-8f94-c2e02dfcf7df]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-f233bc45-1f1b-477b-862d-0bd7e919754c tempest-SnapshotDependencyTests-1321409833 None] Lock "cinder-188b1212-2c62-4409-b86c-8824316c16d7-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:01 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 Sep 28 21:56:01 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:01 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.info" returned: 0 in 0.286s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:01 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.info is being set with open permissions: ugo+rw Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:01 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.info Sep 28 21:56:01 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:01 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967" returned: 0 in 0.404s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:01 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:01 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967 Sep 28 21:56:01 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:02 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.info" returned: 0 in 0.285s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:02 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-d8e7dec1-8113-48fe-9c38-76ad500515a1 tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:56:02 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-056b50b8-d5ee-458c-95e6-ce0795934967" returned: 0 in 0.261s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-056b50b8-d5ee-458c-95e6-ce0795934967" released by "delete_volume" :: held 0.753s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Created reservations ['9a395484-dcd7-4313-b964-36cef25fd565', 'f13e96df-a5e4-405d-ab37-ef6ea8ffc8d7', '137f1d3f-ef1a-4511-8690-453732b3eb88', 'dba70eb3-f38e-4d81-9a99-a70a9a719292'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:02 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:02 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:02 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.284s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:02 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Deleted volume successfully. Sep 28 21:56:02 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-973b8c1c-f88d-4b4a-a3ab-743016e213c4 tempest-ProjectReaderTests-451017063 None] Lock "cinder-056b50b8-d5ee-458c-95e6-ce0795934967-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-4f236f64-c339-41e5-ae09-adc5ab0cda0b-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (fa691237-ada3-4a0f-9d95-eb31fccc20bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d2266e-f8bc-44ce-83cd-96ca42254331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Lock "cinder-4f236f64-c339-41e5-ae09-adc5ab0cda0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-50adffce-fa22-4e84-8872-b02dea997650" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d2266e-f8bc-44ce-83cd-96ca42254331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734206670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0d668c-9953-48f9-b718-9d0c75692690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:03Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff865f6b-9e78-4358-9949-97904340e976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff865f6b-9e78-4358-9949-97904340e976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2308f8-f480-4cd8-ac37-91ea76c4adc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2308f8-f480-4cd8-ac37-91ea76c4adc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0d668c-9953-48f9-b718-9d0c75692690', 'volume_name': 'volume-9d0d668c-9953-48f9-b718-9d0c75692690', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9711b6e-19f4-4fee-8c70-ba062172006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9711b6e-19f4-4fee-8c70-ba062172006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157150bb-246c-40c2-9caf-52b5766d0de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:03 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Volume 9d0d668c-9953-48f9-b718-9d0c75692690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0d668c-9953-48f9-b718-9d0c75692690', 'volume_size': 1} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734206670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0d668c-9953-48f9-b718-9d0c75692690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:03Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Creating volume 9d0d668c-9953-48f9-b718-9d0c75692690 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:03 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-50adffce-fa22-4e84-8872-b02dea997650" acquired by "delete_snapshot" :: waited 0.083s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-4f236f64-c339-41e5-ae09-adc5ab0cda0b" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:03 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 1073741824 Sep 28 21:56:03 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-4f236f64-c339-41e5-ae09-adc5ab0cda0b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot 4f236f64-c339-41e5-ae09-adc5ab0cda0b of volume 50adffce-fa22-4e84-8872-b02dea997650 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4903ab50-24d7-4c10-a487-efcf411be980]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:03 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b Sep 28 21:56:03 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:03 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b" returned: 0 in 0.428s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50adffce-fa22-4e84-8872-b02dea997650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:03 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 1073741824" returned: 0 in 0.558s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3986bbce-6424-42d2-87af-ccab444fdc27]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:03 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 Sep 28 21:56:03 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:03 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 Sep 28 21:56:03 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:04 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690" returned: 0 in 0.259s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157150bb-246c-40c2-9caf-52b5766d0de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0d668c-9953-48f9-b718-9d0c75692690', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdc05d3-6e43-49e9-9ac1-2bf30c6feb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:04 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Volume volume-9d0d668c-9953-48f9-b718-9d0c75692690 (9d0d668c-9953-48f9-b718-9d0c75692690): created successfully Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdc05d3-6e43-49e9-9ac1-2bf30c6feb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (fa691237-ada3-4a0f-9d95-eb31fccc20bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-fcff1fe0-fb4e-42fa-b84d-10b30bc02df6 tempest-ProjectReaderTests-451017063 None] Created volume successfully. Sep 28 21:56:04 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650" returned: 0 in 0.456s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:04 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b Sep 28 21:56:04 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:04 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b" returned: 0 in 0.331s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:04 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b Sep 28 21:56:04 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:04 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650.4f236f64-c339-41e5-ae09-adc5ab0cda0b" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-4f236f64-c339-41e5-ae09-adc5ab0cda0b" released by "_delete_snapshot" :: held 1.598s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-50adffce-fa22-4e84-8872-b02dea997650" released by "delete_snapshot" :: held 1.624s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Created reservations ['a4f1649d-d28f-4500-88f1-c7c9208b02e3', 'faf2ac63-3657-46fe-92f1-53b92c35e024', 'de3c7e3f-bff5-469e-a436-dcc3707a2c0b', '687789bc-22df-4896-a7b1-14c2f50b0bf5'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:56:04 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-46ce20d7-8173-4520-84c1-e49571477178 tempest-ProjectMemberTests-149632569 None] Lock "cinder-4f236f64-c339-41e5-ae09-adc5ab0cda0b-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-50adffce-fa22-4e84-8872-b02dea997650-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Lock "cinder-50adffce-fa22-4e84-8872-b02dea997650-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Creating offline snapshot 383cd835-f3d8-4003-a33a-7731597797ff of volume 9d0d668c-9953-48f9-b718-9d0c75692690 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-50adffce-fa22-4e84-8872-b02dea997650" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac010d-ee69-4f5c-b13e-4848f1fe185e]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-50adffce-fa22-4e84-8872-b02dea997650" acquired by "delete_volume" :: waited 0.037s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d26566-0f6d-4819-aeb9-c3c43b8537ba]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:05 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 Sep 28 21:56:05 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:05 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 Sep 28 21:56:05 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:05 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690" returned: 0 in 0.408s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:05 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff 1G Sep 28 21:56:05 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:05 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650" returned: 0 in 0.435s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:05 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650 Sep 28 21:56:05 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:06 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-50adffce-fa22-4e84-8872-b02dea997650" returned: 0 in 0.307s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-50adffce-fa22-4e84-8872-b02dea997650" released by "delete_volume" :: held 0.813s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Created reservations ['686c960d-fc6d-46a8-ad93-fce802fc5fa5', '26d63fd0-41b0-4169-954c-bd268304f7aa', 'e7a9edc4-6a3b-4c34-bd11-9670e1087b40', '0269c018-5565-479b-8329-a3cf78a34d04'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:06 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff 1G" returned: 0 in 0.528s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0d668c-9953-48f9-b718-9d0c75692690 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:06 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0d668c-9953-48f9-b718-9d0c75692690 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff Sep 28 21:56:06 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:06 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:06 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:06 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:06 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.296s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0d668c-9953-48f9-b718-9d0c75692690 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff" returned: 0 in 0.379s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:06 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff is being set with open permissions: ugo+rw Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:56:06 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff Sep 28 21:56:06 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1d11a2fb-9538-4f7e-9c07-6c10365af097 tempest-ProjectMemberTests-149632569 None] Lock "cinder-50adffce-fa22-4e84-8872-b02dea997650-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:06 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff" returned: 0 in 0.328s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:07 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.info Sep 28 21:56:07 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (41a49687-3f3d-4e80-a91c-d73a4a3cb861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58befb7b-fff8-49cd-8b11-f86e81e41640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58befb7b-fff8-49cd-8b11-f86e81e41640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416553347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65259420-eb4a-4bdb-9029-d23e70d2d789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:07Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66be93e-c7c9-49b5-acf4-df763870769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66be93e-c7c9-49b5-acf4-df763870769e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2f6867-30e7-41c7-94cf-d71e232232ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2f6867-30e7-41c7-94cf-d71e232232ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65259420-eb4a-4bdb-9029-d23e70d2d789', 'volume_name': 'volume-65259420-eb4a-4bdb-9029-d23e70d2d789', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c7d008-d107-40f7-bcb3-962dfe043eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c7d008-d107-40f7-bcb3-962dfe043eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915ea159-17ed-4b53-b81b-8c60e5fcec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:07 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Volume 65259420-eb4a-4bdb-9029-d23e70d2d789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65259420-eb4a-4bdb-9029-d23e70d2d789', 'volume_size': 1} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:07 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.info" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:07 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.info is being set with open permissions: ugo+rw Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:07 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.info Sep 28 21:56:07 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:07 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:07 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:07 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.info" returned: 0 in 0.262s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416553347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65259420-eb4a-4bdb-9029-d23e70d2d789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:07Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Creating volume 65259420-eb4a-4bdb-9029-d23e70d2d789 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:07 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:07 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 1073741824 Sep 28 21:56:07 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:07 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-baca8dba-fa86-40a6-8fe3-1bf7c34f93a6 tempest-ProjectReaderTests-451017063 None] Create snapshot completed successfully Sep 28 21:56:07 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.296s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:56:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:56:08 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 1073741824" returned: 0 in 0.493s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:08 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 Sep 28 21:56:08 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:08 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915ea159-17ed-4b53-b81b-8c60e5fcec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65259420-eb4a-4bdb-9029-d23e70d2d789', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9b896d-b02d-4347-b4c3-144f220c8156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:08 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Volume volume-65259420-eb4a-4bdb-9029-d23e70d2d789 (65259420-eb4a-4bdb-9029-d23e70d2d789): created successfully Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9b896d-b02d-4347-b4c3-144f220c8156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (41a49687-3f3d-4e80-a91c-d73a4a3cb861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:08 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1dbc9b3a-eea3-4600-b5b9-79818606ce50 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-383cd835-f3d8-4003-a33a-7731597797ff-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Lock "cinder-383cd835-f3d8-4003-a33a-7731597797ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-9d0d668c-9953-48f9-b718-9d0c75692690" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-9d0d668c-9953-48f9-b718-9d0c75692690" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-383cd835-f3d8-4003-a33a-7731597797ff" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-383cd835-f3d8-4003-a33a-7731597797ff" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Deleting offline snapshot 383cd835-f3d8-4003-a33a-7731597797ff of volume 9d0d668c-9953-48f9-b718-9d0c75692690 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] snapshot_file for this snap is: volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ef902-27fc-46e4-908c-690a17e7cd84]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:08 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff Sep 28 21:56:08 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:08 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff" returned: 0 in 0.398s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:08 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0d668c-9953-48f9-b718-9d0c75692690(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[049b33c0-e1f9-4099-908b-e402dabd80a5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:09 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 Sep 28 21:56:09 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Creating offline snapshot 5adca176-7ec4-470c-b2f7-78db582c39d1 of volume 65259420-eb4a-4bdb-9029-d23e70d2d789 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bfce90-e49a-4741-a67d-59d169ca06d1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:09 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 Sep 28 21:56:09 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:09 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690" returned: 0 in 0.471s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:09 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff Sep 28 21:56:09 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:09 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789" returned: 0 in 0.473s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:09 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 1G Sep 28 21:56:09 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:09 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff" returned: 0 in 0.475s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:09 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:09 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff Sep 28 21:56:09 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:10 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 1G" returned: 0 in 0.476s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65259420-eb4a-4bdb-9029-d23e70d2d789 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:10 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690.383cd835-f3d8-4003-a33a-7731597797ff" returned: 0 in 0.310s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:10 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65259420-eb4a-4bdb-9029-d23e70d2d789 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 Sep 28 21:56:10 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-383cd835-f3d8-4003-a33a-7731597797ff" released by "_delete_snapshot" :: held 1.782s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-9d0d668c-9953-48f9-b718-9d0c75692690" released by "delete_snapshot" :: held 1.806s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Created reservations ['4eded760-6cff-4d66-acfa-9dd526ebfbbd', '94dd457d-c1c8-41c3-a975-3f0981666dcb', '6ea5ca73-a00c-40bf-928e-7d0ce98302b8', '724782f6-a3af-4f52-8037-93ba037d7254'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:10 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Delete snapshot completed successfully. Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b625f72b-7945-4c76-af5e-a431cb94484c tempest-ProjectReaderTests-451017063 None] Lock "cinder-383cd835-f3d8-4003-a33a-7731597797ff-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:10 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65259420-eb4a-4bdb-9029-d23e70d2d789 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1" returned: 0 in 0.332s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:10 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 is being set with open permissions: ugo+rw Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:10 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 Sep 28 21:56:10 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-9d0d668c-9953-48f9-b718-9d0c75692690-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Lock "cinder-9d0d668c-9953-48f9-b718-9d0c75692690-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-9d0d668c-9953-48f9-b718-9d0c75692690" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-9d0d668c-9953-48f9-b718-9d0c75692690" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a4b21c-fe8c-43f0-bd21-6e3f1335abb7]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:10 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1" returned: 0 in 0.343s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:10 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.info Sep 28 21:56:10 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 Sep 28 21:56:10 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:10 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:11 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.info" returned: 0 in 0.276s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:11 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.info is being set with open permissions: ugo+rw Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:11 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690" returned: 0 in 0.390s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:11 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.info Sep 28 21:56:11 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:11 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690 Sep 28 21:56:11 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:11 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.info" returned: 0 in 0.268s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:11 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-9d0d668c-9953-48f9-b718-9d0c75692690" returned: 0 in 0.276s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-9d0d668c-9953-48f9-b718-9d0c75692690" released by "delete_volume" :: held 0.750s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:11 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-558ee5cd-2c89-4dbc-ae70-d5f96601da83 tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Created reservations ['bb53da58-6bb5-461e-af3c-44ef9e1bd6a6', 'b4a54c5a-bac6-4a4e-9e2f-da88259b41b0', 'df03d4ed-3333-4efc-8afc-b0189c44c448', 'b9293053-3798-4da6-b82a-c559b1812248'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:11 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:11 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:11 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:12 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.293s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:12 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Deleted volume successfully. Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-266f7b96-645c-4823-a0b4-baa173f3d8c7 tempest-ProjectReaderTests-451017063 None] Lock "cinder-9d0d668c-9953-48f9-b718-9d0c75692690-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (4446b573-a4ce-4aca-bc25-5caf9e1e296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3addecb-5c90-4496-be5b-0962ce4748d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3addecb-5c90-4496-be5b-0962ce4748d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285123833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c3f622-f15e-4d1a-a40e-dbb75698c51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:12Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3244022-ee1e-4b63-a4c6-e1893040aa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3244022-ee1e-4b63-a4c6-e1893040aa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449ea963-53af-4aa4-9f1e-5292f242bfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449ea963-53af-4aa4-9f1e-5292f242bfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c3f622-f15e-4d1a-a40e-dbb75698c51a', 'volume_name': 'volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a37ef23-3e81-49bc-8791-6cc0f5deaf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a37ef23-3e81-49bc-8791-6cc0f5deaf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d845cd-3d0a-45e7-ba97-619a2ed48f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:12 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Volume e7c3f622-f15e-4d1a-a40e-dbb75698c51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a', 'volume_size': 1} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285123833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c3f622-f15e-4d1a-a40e-dbb75698c51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:12Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Creating volume e7c3f622-f15e-4d1a-a40e-dbb75698c51a {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:12 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-5adca176-7ec4-470c-b2f7-78db582c39d1-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:12 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a 1073741824 Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Lock "cinder-5adca176-7ec4-470c-b2f7-78db582c39d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-65259420-eb4a-4bdb-9029-d23e70d2d789" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:12 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-65259420-eb4a-4bdb-9029-d23e70d2d789" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-5adca176-7ec4-470c-b2f7-78db582c39d1" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-5adca176-7ec4-470c-b2f7-78db582c39d1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot 5adca176-7ec4-470c-b2f7-78db582c39d1 of volume 65259420-eb4a-4bdb-9029-d23e70d2d789 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97950f2-69b4-4093-9b7a-34b87e0be227]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:12 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 Sep 28 21:56:12 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:13 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a 1073741824" returned: 0 in 0.508s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:13 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1" returned: 0 in 0.426s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65259420-eb4a-4bdb-9029-d23e70d2d789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:13 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a Sep 28 21:56:13 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eec9e8c-f9b2-49a6-b927-d4d5a15c8dc2]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:13 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 Sep 28 21:56:13 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:13 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" returned: 0 in 0.255s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d845cd-3d0a-45e7-ba97-619a2ed48f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47cc9a4-1b25-48df-8b93-fd6cf9023b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:13 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Volume volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a (e7c3f622-f15e-4d1a-a40e-dbb75698c51a): created successfully Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47cc9a4-1b25-48df-8b93-fd6cf9023b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (4446b573-a4ce-4aca-bc25-5caf9e1e296e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:13 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-11151ed7-4378-4c80-826d-6b145eed890c tempest-ProjectReaderTests-451017063 None] Created volume successfully. Sep 28 21:56:13 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789" returned: 0 in 0.380s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:13 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 Sep 28 21:56:13 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:13 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1" returned: 0 in 0.326s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:13 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:13 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1 Sep 28 21:56:13 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:14 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789.5adca176-7ec4-470c-b2f7-78db582c39d1" returned: 0 in 0.251s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-5adca176-7ec4-470c-b2f7-78db582c39d1" released by "_delete_snapshot" :: held 1.501s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-65259420-eb4a-4bdb-9029-d23e70d2d789" released by "delete_snapshot" :: held 1.527s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Created reservations ['de7fd725-a04f-4a47-8d5a-fa88e4398623', '2492f59d-ab3c-448e-bbf8-f1b45f929b5d', '411a1fcb-64f2-4aef-8407-02d0d342c88d', 'b9012bfe-1ff0-4b93-b30e-9c7651106467'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:14 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-dce9640b-2baf-411b-9b7e-6d9c3231f575 tempest-ProjectMemberTests-149632569 None] Lock "cinder-5adca176-7ec4-470c-b2f7-78db582c39d1-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Creating offline snapshot 6e37bfab-8e7b-4f40-ba56-9e35732834d8 of volume e7c3f622-f15e-4d1a-a40e-dbb75698c51a {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d9c7ad-6d82-471a-b23a-92f4b4e6634c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-65259420-eb4a-4bdb-9029-d23e70d2d789-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Lock "cinder-65259420-eb4a-4bdb-9029-d23e70d2d789-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-65259420-eb4a-4bdb-9029-d23e70d2d789" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-65259420-eb4a-4bdb-9029-d23e70d2d789" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:14 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a Sep 28 21:56:14 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e691bfc-c237-4505-a0d9-0990edba4ab3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:14 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 Sep 28 21:56:14 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:14 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" returned: 0 in 0.383s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:15 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 1G Sep 28 21:56:15 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:15 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789" returned: 0 in 0.371s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:15 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789 Sep 28 21:56:15 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:15 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 1G" returned: 0 in 0.384s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:15 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-65259420-eb4a-4bdb-9029-d23e70d2d789" returned: 0 in 0.254s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:15 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 Sep 28 21:56:15 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-65259420-eb4a-4bdb-9029-d23e70d2d789" released by "delete_volume" :: held 0.693s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Created reservations ['987d80bf-25c4-4ea5-a711-e65f7b835523', '215d3c1f-5a5f-4d38-8473-30ef13e3501e', '52254f2c-534a-4be1-be0b-9372ce1d33f9', '30ae86e6-6fe0-475a-a9df-aeeae33e7766'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:15 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:15 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:15 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8" returned: 0 in 0.308s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:15 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 is being set with open permissions: ugo+rw Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:15 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 Sep 28 21:56:15 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:15 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.266s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:15 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-6b7f3cc9-1f7a-41ea-b4f7-7311e2899ebf tempest-ProjectMemberTests-149632569 None] Lock "cinder-65259420-eb4a-4bdb-9029-d23e70d2d789-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:15 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8" returned: 0 in 0.286s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:15 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:16 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.info Sep 28 21:56:16 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:16 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (eebc06b8-bb13-47ad-b80b-edb89b58581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11f7678-86d5-472f-9f1e-e0e3d3dee611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.info" returned: 0 in 0.303s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:16 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.info is being set with open permissions: ugo+rw Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:16 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.info Sep 28 21:56:16 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11f7678-86d5-472f-9f1e-e0e3d3dee611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489444260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8902da6c-e7c8-4a3f-bda9-944a3d6fa25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:16Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f11c44a-cfbe-4a49-b87e-7bc21f581e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f11c44a-cfbe-4a49-b87e-7bc21f581e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b11f3b0-db6e-4276-8ef5-8101590b2a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b11f3b0-db6e-4276-8ef5-8101590b2a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8902da6c-e7c8-4a3f-bda9-944a3d6fa25e', 'volume_name': 'volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6a11f3-91a3-4856-9f65-01a744ebc901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6a11f3-91a3-4856-9f65-01a744ebc901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b395bd1-c8c7-40f9-86d6-fc057e0a7f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:16 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Volume 8902da6c-e7c8-4a3f-bda9-944a3d6fa25e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e', 'volume_size': 1} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:16 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.info" returned: 0 in 0.254s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.208s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489444260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8902da6c-e7c8-4a3f-bda9-944a3d6fa25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:16Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Creating volume 8902da6c-e7c8-4a3f-bda9-944a3d6fa25e {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:16 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:16 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e 1073741824 Sep 28 21:56:16 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:16 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-98bad1e7-d110-458a-9a3a-b658ec5625f3 tempest-ProjectReaderTests-451017063 None] Create snapshot completed successfully Sep 28 21:56:17 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e 1073741824" returned: 0 in 0.422s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:17 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e Sep 28 21:56:17 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:17 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" returned: 0 in 0.246s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b395bd1-c8c7-40f9-86d6-fc057e0a7f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66dd53d-3e38-4426-85e5-ecaebc9bb3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:17 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Volume volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e (8902da6c-e7c8-4a3f-bda9-944a3d6fa25e): created successfully Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66dd53d-3e38-4426-85e5-ecaebc9bb3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (eebc06b8-bb13-47ad-b80b-edb89b58581a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8bb8b758-c44e-4206-b3a0-4e0ffe3acfb4 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-6e37bfab-8e7b-4f40-ba56-9e35732834d8-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Lock "cinder-6e37bfab-8e7b-4f40-ba56-9e35732834d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-6e37bfab-8e7b-4f40-ba56-9e35732834d8" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-6e37bfab-8e7b-4f40-ba56-9e35732834d8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Deleting offline snapshot 6e37bfab-8e7b-4f40-ba56-9e35732834d8 of volume e7c3f622-f15e-4d1a-a40e-dbb75698c51a {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] snapshot_file for this snap is: volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df73c00-f37c-4439-b640-7ad3e4240f18]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:17 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:17 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 Sep 28 21:56:17 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:18 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8" returned: 0 in 0.364s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd6a72-b296-45f6-9f20-de9454353d47]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:18 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a Sep 28 21:56:18 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=179,cinder:INSERT=58,cinder:UPDATE=218,cinder:DELETE=25 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=181,cinder:INSERT=66,cinder:UPDATE=254,cinder:DELETE=15 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Creating offline snapshot 165e2225-379f-4363-8c77-236a60a10890 of volume 8902da6c-e7c8-4a3f-bda9-944a3d6fa25e {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f1f11e-559c-4250-b794-3d3e212de79f]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:18 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" returned: 0 in 0.375s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:18 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 Sep 28 21:56:18 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:18 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e Sep 28 21:56:18 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:18 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" returned: 0 in 0.389s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:18 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8" returned: 0 in 0.367s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:18 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:18 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 1G Sep 28 21:56:18 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:18 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8 Sep 28 21:56:18 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:19 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a.6e37bfab-8e7b-4f40-ba56-9e35732834d8" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-6e37bfab-8e7b-4f40-ba56-9e35732834d8" released by "_delete_snapshot" :: held 1.448s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" released by "delete_snapshot" :: held 1.469s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Created reservations ['d6ef98c5-e1f8-434f-8e50-fc241c0e5fef', 'a90aeb1f-207f-481f-bc4c-0992b20c8812', 'a5db1751-92e8-4d35-9a4a-23146f5fba88', 'a699e683-c293-4ff8-b639-65b170aa9de7'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:19 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 1G" returned: 0 in 0.418s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:19 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Delete snapshot completed successfully. Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-7c3ffd97-bd8e-4ad3-8c9e-064917240e00 tempest-ProjectReaderTests-451017063 None] Lock "cinder-6e37bfab-8e7b-4f40-ba56-9e35732834d8-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:19 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 Sep 28 21:56:19 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:19 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890" returned: 0 in 0.291s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:19 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 is being set with open permissions: ugo+rw Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:19 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 Sep 28 21:56:19 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:19 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890" returned: 0 in 0.248s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-e7c3f622-f15e-4d1a-a40e-dbb75698c51a-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Lock "cinder-e7c3f622-f15e-4d1a-a40e-dbb75698c51a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:19 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.info Sep 28 21:56:19 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:19 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" acquired by "delete_volume" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bbdb26-1081-4587-b076-30872bf95a28]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:20 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a Sep 28 21:56:20 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:20 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.info" returned: 0 in 0.263s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:20 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.info is being set with open permissions: ugo+rw Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:20 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.info Sep 28 21:56:20 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:20 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" returned: 0 in 0.361s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:20 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a Sep 28 21:56:20 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:20 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.info" returned: 0 in 0.255s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:20 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a4b14ccd-78de-4f44-8d4d-2fe589e8a339 tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:56:20 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" returned: 0 in 0.264s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-e7c3f622-f15e-4d1a-a40e-dbb75698c51a" released by "delete_volume" :: held 0.689s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Created reservations ['5d9c7c43-e911-46f8-888a-12cbe6b7d36b', '5de412e0-796b-4823-bccc-fbd12df67b9b', '3e7d175c-b095-429c-92a8-2914697eeeaf', 'cef8faf6-1e09-42bc-a6f5-3b0d8357f1da'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:20 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:20 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:20 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:21 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.243s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:21 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Deleted volume successfully. Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-c31638a0-53c5-4a17-b36c-32e3d7d2c0e0 tempest-ProjectReaderTests-451017063 None] Lock "cinder-e7c3f622-f15e-4d1a-a40e-dbb75698c51a-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (f3046c56-f11e-456b-bdd6-f36c13de100d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a6a6e5-f27d-45fa-a218-bda7ce7b71fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a6a6e5-f27d-45fa-a218-bda7ce7b71fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985813419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5be8dc-167e-4202-a5c4-6c0aeb159fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:21Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba1fa28-31ad-487e-81b1-fd168246de4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba1fa28-31ad-487e-81b1-fd168246de4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd5ba91-46ad-4839-afb1-5543031e9f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd5ba91-46ad-4839-afb1-5543031e9f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5be8dc-167e-4202-a5c4-6c0aeb159fa3', 'volume_name': 'volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc432130-4e08-4505-8abd-6578e118e32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc432130-4e08-4505-8abd-6578e118e32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448ee0fa-dfe4-4c09-b81c-8f372fcacbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:21 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Volume 3e5be8dc-167e-4202-a5c4-6c0aeb159fa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3', 'volume_size': 1} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985813419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5be8dc-167e-4202-a5c4-6c0aeb159fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08340558b12b4a7e8be1403910098420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:21Z,use_quota=True,user_id='e0828da9d7be4def95ded72f0c481246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Creating volume 3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:21 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:21 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 1073741824 Sep 28 21:56:21 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-165e2225-379f-4363-8c77-236a60a10890-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Lock "cinder-165e2225-379f-4363-8c77-236a60a10890-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-165e2225-379f-4363-8c77-236a60a10890" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-165e2225-379f-4363-8c77-236a60a10890" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot 165e2225-379f-4363-8c77-236a60a10890 of volume 8902da6c-e7c8-4a3f-bda9-944a3d6fa25e {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc070253-02b9-4a6a-9b61-eac1c4695614]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:21 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:21 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 Sep 28 21:56:21 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:22 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 1073741824" returned: 0 in 0.445s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:22 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 Sep 28 21:56:22 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:22 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890" returned: 0 in 0.389s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b54ca95-2f1f-40da-80dd-7fa340f9cb77]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:22 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e Sep 28 21:56:22 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:22 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" returned: 0 in 0.251s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448ee0fa-dfe4-4c09-b81c-8f372fcacbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede24c45-f206-4ca7-b152-d86d05218596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:22 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Volume volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 (3e5be8dc-167e-4202-a5c4-6c0aeb159fa3): created successfully Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede24c45-f206-4ca7-b152-d86d05218596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Flow 'volume_create_manager' (f3046c56-f11e-456b-bdd6-f36c13de100d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:22 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-893acb5a-17d8-4de6-ab12-d6db7fbb2928 tempest-ProjectReaderTests-451017063 None] Created volume successfully. Sep 28 21:56:22 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" returned: 0 in 0.394s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:22 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 Sep 28 21:56:22 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Creating offline snapshot aaf5e535-d7d5-4824-85a6-5b0dc958ce9a of volume 3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[062bfb1f-3f67-4e23-9a3a-e65b33a813f3]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:22 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 Sep 28 21:56:22 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:22 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890" returned: 0 in 0.364s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:22 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:22 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890 Sep 28 21:56:22 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:23 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" returned: 0 in 0.386s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:23 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a 1G Sep 28 21:56:23 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:23 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e.165e2225-379f-4363-8c77-236a60a10890" returned: 0 in 0.260s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-165e2225-379f-4363-8c77-236a60a10890" released by "_delete_snapshot" :: held 1.511s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" released by "delete_snapshot" :: held 1.541s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Created reservations ['1dd2dfa9-5626-4f41-b8e0-e05664d250fb', '2572db07-4839-4943-bf4f-f4d52d2b10c7', '6c1d8d36-f58f-4584-b9ba-7b8c885cf2bd', '55ac1ebd-f816-46b2-9371-bd910ae7b5f4'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:23 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-b00c6958-7fbc-4a73-8588-c162653eb2aa tempest-ProjectMemberTests-149632569 None] Lock "cinder-165e2225-379f-4363-8c77-236a60a10890-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:23 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a 1G" returned: 0 in 0.409s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:23 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a Sep 28 21:56:23 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:23 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a" returned: 0 in 0.300s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:23 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a is being set with open permissions: ugo+rw Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:23 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a Sep 28 21:56:23 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Lock "cinder-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" acquired by "delete_volume" :: waited 0.024s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0795af-b1d7-4383-9260-a6f9e2a9d35c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:23 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:24 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a" returned: 0 in 0.286s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:24 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e Sep 28 21:56:24 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:24 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.info Sep 28 21:56:24 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:24 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" returned: 0 in 0.378s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:24 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.info" returned: 0 in 0.272s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:24 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.info is being set with open permissions: ugo+rw Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:24 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e Sep 28 21:56:24 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:24 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.info Sep 28 21:56:24 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:24 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" returned: 0 in 0.278s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:24 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e" released by "delete_volume" :: held 0.746s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.info" returned: 0 in 0.290s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:24 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-aa1bcc87-4a89-4bc0-9ba2-f97d41858dfe tempest-ProjectReaderTests-451017063 None] Create snapshot completed successfully Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Created reservations ['99c12f73-19ce-4b3f-b3d2-3d2b34269799', '8228503b-92bc-46d7-925e-a4a127116196', '7504d359-b6c1-4ab4-b33a-4e89e361f45b', '03b17c15-972e-4064-9006-5297165f4ac5'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:24 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:24 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:24 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:25 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.262s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:25 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3f7a8c2c-be54-4ffc-903a-9e1db1f0fbef tempest-ProjectMemberTests-149632569 None] Lock "cinder-8902da6c-e7c8-4a3f-bda9-944a3d6fa25e-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (47077330-b50f-48d7-89d1-e3937aa3cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d9ccad-7fad-433b-94f8-565efd60c6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d9ccad-7fad-433b-94f8-565efd60c6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433463480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a015aa37-20a9-46cf-8cdd-1dff0510f45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:25Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88ac407-4073-4d57-b243-8e3152d932b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88ac407-4073-4d57-b243-8e3152d932b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00bb116-6d30-4c9d-9364-23efac7e78ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00bb116-6d30-4c9d-9364-23efac7e78ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a015aa37-20a9-46cf-8cdd-1dff0510f45d', 'volume_name': 'volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63876086-77e8-4b05-85e3-bb4ea2053ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63876086-77e8-4b05-85e3-bb4ea2053ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7049ebb7-5158-4167-bcbc-b3d7f7baa47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:25 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Volume a015aa37-20a9-46cf-8cdd-1dff0510f45d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d', 'volume_size': 1} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433463480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a015aa37-20a9-46cf-8cdd-1dff0510f45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:25Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Creating volume a015aa37-20a9-46cf-8cdd-1dff0510f45d {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:25 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:25 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d 1073741824 Sep 28 21:56:25 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-aaf5e535-d7d5-4824-85a6-5b0dc958ce9a-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Lock "cinder-aaf5e535-d7d5-4824-85a6-5b0dc958ce9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-aaf5e535-d7d5-4824-85a6-5b0dc958ce9a" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-aaf5e535-d7d5-4824-85a6-5b0dc958ce9a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Deleting offline snapshot aaf5e535-d7d5-4824-85a6-5b0dc958ce9a of volume 3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] snapshot_file for this snap is: volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a6118-1d3c-4a79-82d4-57c12320974a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:25 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:25 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d 1073741824" returned: 0 in 0.464s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:26 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a Sep 28 21:56:26 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:26 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d Sep 28 21:56:26 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:26 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d" returned: 0 in 0.257s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7049ebb7-5158-4167-bcbc-b3d7f7baa47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5842527-cde6-4497-9e06-ff35a9094c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:26 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a" returned: 0 in 0.368s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:26 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Volume volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d (a015aa37-20a9-46cf-8cdd-1dff0510f45d): created successfully Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5842527-cde6-4497-9e06-ff35a9094c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (47077330-b50f-48d7-89d1-e3937aa3cb20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[75000918-72c0-47d7-be17-a90971fbdba5]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:26 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-6ba14f85-c074-44ca-be1d-f88aae6a8617 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:56:26 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 Sep 28 21:56:26 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Creating offline snapshot 9d700505-29e5-492a-9f90-8bdbc24c7098 of volume a015aa37-20a9-46cf-8cdd-1dff0510f45d {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae43180-3950-4b87-90e8-3307515d3404]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:26 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" returned: 0 in 0.385s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:26 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:26 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d Sep 28 21:56:26 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:26 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a Sep 28 21:56:26 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:27 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d" returned: 0 in 0.396s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:27 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 1G Sep 28 21:56:27 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:27 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a" returned: 0 in 0.364s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:27 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a Sep 28 21:56:27 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:27 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3.aaf5e535-d7d5-4824-85a6-5b0dc958ce9a" returned: 0 in 0.289s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-aaf5e535-d7d5-4824-85a6-5b0dc958ce9a" released by "_delete_snapshot" :: held 1.529s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" released by "delete_snapshot" :: held 1.553s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:27 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 1G" returned: 0 in 0.416s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:27 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 Sep 28 21:56:27 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Created reservations ['f2149fd0-d02f-40ec-bddf-6fd520129a69', '787b91a1-cba4-4bd5-a708-161a4baeafd1', '272e9cca-d31f-427c-9c20-1c2bcab2cedc', 'f5b3a328-d49c-4d9a-ac2d-0f61019e637b'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:27 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Delete snapshot completed successfully. Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-457daddf-7ce3-41f8-90d4-edce17d713fa tempest-ProjectReaderTests-451017063 None] Lock "cinder-aaf5e535-d7d5-4824-85a6-5b0dc958ce9a-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:27 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098" returned: 0 in 0.294s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:27 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 is being set with open permissions: ugo+rw Sep 28 21:56:27 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:27 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 Sep 28 21:56:27 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:28 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098" returned: 0 in 0.266s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:28 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.info Sep 28 21:56:28 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "cinder-quobyte-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b845b548-159a-46de-8bdd-3f7fd7739d6d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:28 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 Sep 28 21:56:28 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:28 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.info" returned: 0 in 0.254s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:28 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.info is being set with open permissions: ugo+rw Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:28 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.info Sep 28 21:56:28 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:28 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" returned: 0 in 0.364s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:28 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3 Sep 28 21:56:28 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:28 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.info" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:28 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ee999a68-598e-4a88-94db-f0260ed983be tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-9d700505-29e5-492a-9f90-8bdbc24c7098-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-9d700505-29e5-492a-9f90-8bdbc24c7098-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-a015aa37-20a9-46cf-8cdd-1dff0510f45d" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:28 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" returned: 0 in 0.269s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-quobyte-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3" released by "delete_volume" :: held 0.702s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-a015aa37-20a9-46cf-8cdd-1dff0510f45d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-9d700505-29e5-492a-9f90-8bdbc24c7098" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-9d700505-29e5-492a-9f90-8bdbc24c7098" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot 9d700505-29e5-492a-9f90-8bdbc24c7098 of volume a015aa37-20a9-46cf-8cdd-1dff0510f45d {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d03a23-2dfc-4c49-a74e-39124f7e532c]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Created reservations ['a05b434b-2ad2-44cf-a30d-94eaea6e39b0', '76590581-7a5c-470b-b829-dd50ea098605', 'a6cb6f53-afd5-4f52-9e26-c1f7838a6fe6', '790fb37a-1211-4f4f-83e1-8af0580f3f51'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:28 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:28 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 Sep 28 21:56:28 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:28 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:28 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:29 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:29 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Deleted volume successfully. Sep 28 21:56:29 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098" returned: 0 in 0.383s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037acf3-3bf0-4cb5-82e0-e628d94f1474]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-3957da98-04c0-4f32-98aa-53cbf95c46c6 tempest-ProjectReaderTests-451017063 None] Lock "cinder-3e5be8dc-167e-4202-a5c4-6c0aeb159fa3-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:29 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d Sep 28 21:56:29 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:29 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d" returned: 0 in 0.389s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:29 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:29 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 Sep 28 21:56:29 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:30 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098" returned: 0 in 0.351s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:30 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098 Sep 28 21:56:30 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:30 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d.9d700505-29e5-492a-9f90-8bdbc24c7098" returned: 0 in 0.281s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-9d700505-29e5-492a-9f90-8bdbc24c7098" released by "_delete_snapshot" :: held 1.541s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-a015aa37-20a9-46cf-8cdd-1dff0510f45d" released by "delete_snapshot" :: held 1.565s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Created reservations ['bdb28efb-faa7-4e5b-9166-02d945e9d357', '290baa59-dd00-4b38-b82a-6156b4bf88fc', 'bf09bb62-413d-4c7e-9b8b-3ce911331347', '6b128e4e-1950-496e-b648-c7c19f720181'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:30 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-e49a5421-66c3-4dec-aca2-0b1c9b4ae0e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-9d700505-29e5-492a-9f90-8bdbc24c7098-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-a015aa37-20a9-46cf-8cdd-1dff0510f45d-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Lock "cinder-a015aa37-20a9-46cf-8cdd-1dff0510f45d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:30 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-a015aa37-20a9-46cf-8cdd-1dff0510f45d" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-a015aa37-20a9-46cf-8cdd-1dff0510f45d" acquired by "delete_volume" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a20f3f-c1e2-459f-925d-3533a8ce5274]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:31 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d Sep 28 21:56:31 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:31 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d" returned: 0 in 0.354s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:31 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d Sep 28 21:56:31 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:31 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-a015aa37-20a9-46cf-8cdd-1dff0510f45d" returned: 0 in 0.250s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-a015aa37-20a9-46cf-8cdd-1dff0510f45d" released by "delete_volume" :: held 0.674s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Created reservations ['6838564f-88d9-40a4-add1-7f042e25d009', '220a6b21-c34b-42ca-802e-bafb149bbdc7', '47b05da3-76e0-488b-9205-209c09563ed1', '75bdc5d6-ba08-42ab-8643-c99addd76702'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:31 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:31 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:31 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:32 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:32 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9b64bd8f-2448-45e6-8bb9-8d245711023e tempest-ProjectMemberTests-149632569 None] Lock "cinder-a015aa37-20a9-46cf-8cdd-1dff0510f45d-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (16b23538-3729-4746-a735-1e9d6f2a55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f44bea-f89a-4145-bbd8-99f051be826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f44bea-f89a-4145-bbd8-99f051be826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773666149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56215b2-e511-4c2b-9555-f6821f07a962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:32Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e676f4-e38b-4b26-ab37-b540bb03c951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e676f4-e38b-4b26-ab37-b540bb03c951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a81707-995a-4da1-aa48-65258bedc5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a81707-995a-4da1-aa48-65258bedc5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56215b2-e511-4c2b-9555-f6821f07a962', 'volume_name': 'volume-e56215b2-e511-4c2b-9555-f6821f07a962', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65c6cab-c2ff-4bc2-9204-b1f5461b52dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65c6cab-c2ff-4bc2-9204-b1f5461b52dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b300c495-4653-4028-ac4b-5e08b9106b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:32 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Volume e56215b2-e511-4c2b-9555-f6821f07a962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56215b2-e511-4c2b-9555-f6821f07a962', 'volume_size': 1} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773666149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56215b2-e511-4c2b-9555-f6821f07a962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:32Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Creating volume e56215b2-e511-4c2b-9555-f6821f07a962 {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:32 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:32 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:32 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 1073741824 Sep 28 21:56:32 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:33 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 1073741824" returned: 0 in 0.404s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:33 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 Sep 28 21:56:33 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:33 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962" returned: 0 in 0.245s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b300c495-4653-4028-ac4b-5e08b9106b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56215b2-e511-4c2b-9555-f6821f07a962', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338d57fb-a40e-4953-8b50-b48433fd3ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:33 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Volume volume-e56215b2-e511-4c2b-9555-f6821f07a962 (e56215b2-e511-4c2b-9555-f6821f07a962): created successfully Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338d57fb-a40e-4953-8b50-b48433fd3ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (16b23538-3729-4746-a735-1e9d6f2a55d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:33 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-71d17dac-3a00-4ddb-8716-8ca3be681289 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Creating offline snapshot 882202f3-7eda-4fd3-8112-e607ffaf79e4 of volume e56215b2-e511-4c2b-9555-f6821f07a962 {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34d9b12-4c4c-4c5f-bf95-f9096f51bfdc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:33 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:33 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 Sep 28 21:56:33 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:34 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962" returned: 0 in 0.351s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:34 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 1G Sep 28 21:56:34 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:34 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 1G" returned: 0 in 0.398s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56215b2-e511-4c2b-9555-f6821f07a962 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:34 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56215b2-e511-4c2b-9555-f6821f07a962 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 Sep 28 21:56:34 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:34 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56215b2-e511-4c2b-9555-f6821f07a962 -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4" returned: 0 in 0.290s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:34 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 is being set with open permissions: ugo+rw Sep 28 21:56:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:34 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 Sep 28 21:56:34 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:34 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:34 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4" returned: 0 in 0.245s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:35 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.info Sep 28 21:56:35 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:35 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.info" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:35 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.info is being set with open permissions: ugo+rw Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:35 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.info Sep 28 21:56:35 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:35 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.info" returned: 0 in 0.238s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:35 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3ec0c60a-c1d8-48f1-a779-beab5c849f50 tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-882202f3-7eda-4fd3-8112-e607ffaf79e4-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Lock "cinder-882202f3-7eda-4fd3-8112-e607ffaf79e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-e56215b2-e511-4c2b-9555-f6821f07a962" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-e56215b2-e511-4c2b-9555-f6821f07a962" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-882202f3-7eda-4fd3-8112-e607ffaf79e4" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-882202f3-7eda-4fd3-8112-e607ffaf79e4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot 882202f3-7eda-4fd3-8112-e607ffaf79e4 of volume e56215b2-e511-4c2b-9555-f6821f07a962 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b7e45-7d09-4683-bcf8-1cf81e478e45]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:35 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:35 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 Sep 28 21:56:35 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:36 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:36 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e56215b2-e511-4c2b-9555-f6821f07a962(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:36 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a538ca56-9589-4f50-9e2a-02030ceb0e68]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:36 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 Sep 28 21:56:36 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:36 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962" returned: 0 in 0.350s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:36 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 Sep 28 21:56:36 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:36 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4" returned: 0 in 0.352s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:36 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:36 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4 Sep 28 21:56:36 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:37 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:37 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962.882202f3-7eda-4fd3-8112-e607ffaf79e4" returned: 0 in 0.245s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-882202f3-7eda-4fd3-8112-e607ffaf79e4" released by "_delete_snapshot" :: held 1.392s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-e56215b2-e511-4c2b-9555-f6821f07a962" released by "delete_snapshot" :: held 1.412s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:37 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Created reservations ['954c6de8-626b-4223-bf80-97f4be21509f', '933d1fc3-6a4a-4ee5-9448-2c34e3491ecf', '57044c03-f1e5-4dad-bcb7-693229508f9b', '60a60299-09df-4876-aa42-3d6d9d46fe3d'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:37 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:56:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-2a9479df-5253-4ab6-be46-6279bdca1e24 tempest-ProjectMemberTests-149632569 None] Lock "cinder-882202f3-7eda-4fd3-8112-e607ffaf79e4-delete_snapshot" released by "delete_snapshot" :: held 1.541s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-e56215b2-e511-4c2b-9555-f6821f07a962-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:37 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Lock "cinder-e56215b2-e511-4c2b-9555-f6821f07a962-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-e56215b2-e511-4c2b-9555-f6821f07a962" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-e56215b2-e511-4c2b-9555-f6821f07a962" acquired by "delete_volume" :: waited 0.017s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a16181e-b826-4a2f-8395-38f4557446c1]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:38 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 Sep 28 21:56:38 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:38 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962" returned: 0 in 0.352s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:38 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962 Sep 28 21:56:38 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:38 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-e56215b2-e511-4c2b-9555-f6821f07a962" returned: 0 in 0.238s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-e56215b2-e511-4c2b-9555-f6821f07a962" released by "delete_volume" :: held 0.656s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Created reservations ['ecc62a22-19c9-4a26-b198-d8328fec415f', '95781a88-da1d-4520-a594-325bd6fc4024', '8286b68d-06ac-4ad6-80e8-79caf31013a1', '5f614063-3542-4b4e-b1ef-f5ebaf8732ae'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:38 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:38 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:38 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:39 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.243s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:39 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-927a5e70-f98e-42d7-b7c3-84ef0d37e200 tempest-ProjectMemberTests-149632569 None] Lock "cinder-e56215b2-e511-4c2b-9555-f6821f07a962-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (30585e11-acee-4a02-8455-d77521c5662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211d10d9-9961-4186-a475-d2adb8898873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211d10d9-9961-4186-a475-d2adb8898873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-597884966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99303827-bf55-42f6-9490-f0de11edacdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:39Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b67685-0e31-452b-9e44-9f10e2770e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b67685-0e31-452b-9e44-9f10e2770e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79492c74-f8ca-4c58-9135-7d5d4ac9c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79492c74-f8ca-4c58-9135-7d5d4ac9c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99303827-bf55-42f6-9490-f0de11edacdc', 'volume_name': 'volume-99303827-bf55-42f6-9490-f0de11edacdc', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f84e0b7-c784-483f-b393-55f43efd3624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f84e0b7-c784-483f-b393-55f43efd3624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a32529-e78b-4c3d-9d1a-abf389de118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:39 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Volume 99303827-bf55-42f6-9490-f0de11edacdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99303827-bf55-42f6-9490-f0de11edacdc', 'volume_size': 1} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-597884966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99303827-bf55-42f6-9490-f0de11edacdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:39Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Creating volume 99303827-bf55-42f6-9490-f0de11edacdc {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:39 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:39 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:39 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc 1073741824 Sep 28 21:56:39 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:40 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc 1073741824" returned: 0 in 0.416s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:40 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc Sep 28 21:56:40 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:40 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc" returned: 0 in 0.247s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a32529-e78b-4c3d-9d1a-abf389de118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99303827-bf55-42f6-9490-f0de11edacdc', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f677bfeb-d70b-42e1-ad30-3ceb91f2f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:40 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Volume volume-99303827-bf55-42f6-9490-f0de11edacdc (99303827-bf55-42f6-9490-f0de11edacdc): created successfully Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f677bfeb-d70b-42e1-ad30-3ceb91f2f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (30585e11-acee-4a02-8455-d77521c5662e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:40 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-a3d0d75f-b825-49f9-b20b-db53ff632a93 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Creating offline snapshot 6aa6a998-5677-42cd-bd58-7d4b51c68d27 of volume 99303827-bf55-42f6-9490-f0de11edacdc {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aadb288-a123-420b-818b-757ed5877a53]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:40 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:40 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc Sep 28 21:56:40 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:41 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc" returned: 0 in 0.351s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:41 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 1G Sep 28 21:56:41 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:41 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 1G" returned: 0 in 0.389s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99303827-bf55-42f6-9490-f0de11edacdc -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:41 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99303827-bf55-42f6-9490-f0de11edacdc -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 Sep 28 21:56:41 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:41 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99303827-bf55-42f6-9490-f0de11edacdc -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27" returned: 0 in 0.290s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:41 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 is being set with open permissions: ugo+rw Sep 28 21:56:41 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:41 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 Sep 28 21:56:41 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:42 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27" returned: 0 in 0.247s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:42 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.info Sep 28 21:56:42 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:42 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.info" returned: 0 in 0.251s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:42 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.info is being set with open permissions: ugo+rw Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:42 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.info Sep 28 21:56:42 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:42 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.info" returned: 0 in 0.240s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:42 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-ccbb570d-116d-41ea-a17c-223a5ad9ccc5 tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-6aa6a998-5677-42cd-bd58-7d4b51c68d27-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Lock "cinder-6aa6a998-5677-42cd-bd58-7d4b51c68d27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-99303827-bf55-42f6-9490-f0de11edacdc" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-99303827-bf55-42f6-9490-f0de11edacdc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-6aa6a998-5677-42cd-bd58-7d4b51c68d27" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-6aa6a998-5677-42cd-bd58-7d4b51c68d27" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot 6aa6a998-5677-42cd-bd58-7d4b51c68d27 of volume 99303827-bf55-42f6-9490-f0de11edacdc {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5f7674-d97c-49e4-bbb2-ed0dae88b0bf]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:42 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:43 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 Sep 28 21:56:43 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:43 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27" returned: 0 in 0.351s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:43 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99303827-bf55-42f6-9490-f0de11edacdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:43 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f27fb-8bcd-4073-87bb-a903ce057f14]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:43 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc Sep 28 21:56:43 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:43 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc" returned: 0 in 0.357s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:43 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 Sep 28 21:56:43 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:43 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27" returned: 0 in 0.343s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:43 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:44 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27 Sep 28 21:56:44 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:44 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:44 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc.6aa6a998-5677-42cd-bd58-7d4b51c68d27" returned: 0 in 0.237s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-6aa6a998-5677-42cd-bd58-7d4b51c68d27" released by "_delete_snapshot" :: held 1.383s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-99303827-bf55-42f6-9490-f0de11edacdc" released by "delete_snapshot" :: held 1.403s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:44 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Created reservations ['2d67b5ea-e268-41ee-a9e4-91135f6a8f87', '90e58e34-8a31-4d57-b0f1-3c5db7957913', '1b57cf32-cd59-4c3f-a526-b0998dca3333', '3abb5dfb-09fd-4d2b-843e-0dbeaa482b25'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:44 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:56:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-1a57c2a1-cf3a-4847-b6c4-27c9c61f1013 tempest-ProjectMemberTests-149632569 None] Lock "cinder-6aa6a998-5677-42cd-bd58-7d4b51c68d27-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-99303827-bf55-42f6-9490-f0de11edacdc-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:44 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Lock "cinder-99303827-bf55-42f6-9490-f0de11edacdc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-99303827-bf55-42f6-9490-f0de11edacdc" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-99303827-bf55-42f6-9490-f0de11edacdc" acquired by "delete_volume" :: waited 0.016s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b2c1c4-741d-43c5-917d-ba811289d9dc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:45 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc Sep 28 21:56:45 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:45 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc" returned: 0 in 0.352s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:45 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc Sep 28 21:56:45 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:45 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-99303827-bf55-42f6-9490-f0de11edacdc" returned: 0 in 0.249s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-99303827-bf55-42f6-9490-f0de11edacdc" released by "delete_volume" :: held 0.658s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Created reservations ['81c8894e-c5b3-4000-9bf9-e4b4e89574d5', '3677058d-0bbe-4038-b744-27125886094b', '7b13db63-264c-4665-8585-e2826d432a42', 'd3945d3c-0f95-46d5-94b6-aea07303d9a1'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:45 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:45 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:45 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:46 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.247s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:46 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-9d46d062-d234-4ff3-b9c3-a0faf71bc072 tempest-ProjectMemberTests-149632569 None] Lock "cinder-99303827-bf55-42f6-9490-f0de11edacdc-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (e2103498-097f-490c-b940-00dd44831557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d74822-eb71-4100-8a04-d0c327c61a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d74822-eb71-4100-8a04-d0c327c61a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744839369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcc3b88-f766-4a29-9cab-91114611a9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:47Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e71d98-d823-4e95-9ddd-687f3aba0941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e71d98-d823-4e95-9ddd-687f3aba0941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3774df80-84ff-4e7f-b6b8-dfc01258549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3774df80-84ff-4e7f-b6b8-dfc01258549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dcc3b88-f766-4a29-9cab-91114611a9eb', 'volume_name': 'volume-1dcc3b88-f766-4a29-9cab-91114611a9eb', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b582e91-d85b-40a5-a085-60ed15d3dade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b582e91-d85b-40a5-a085-60ed15d3dade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f12f02-2d0f-4ce6-8d05-a6fecb12235b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:46 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Volume 1dcc3b88-f766-4a29-9cab-91114611a9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dcc3b88-f766-4a29-9cab-91114611a9eb', 'volume_size': 1} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T19:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744839369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcc3b88-f766-4a29-9cab-91114611a9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441f0ac60d2348cba9589a9cf4e68998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T19:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T19:56:47Z,use_quota=True,user_id='ddd94a0fcadf4cd1bca1de3ed2e192f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b3e06c-5658-4191-830f-018aedea6c4c),volume_type_id=20b3e06c-5658-4191-830f-018aedea6c4c)}" {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Creating volume 1dcc3b88-f766-4a29-9cab-91114611a9eb {{(pid=86489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Selected osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 as target Quobyte volume. {{(pid=86489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 21:56:46 devstack cinder-volume[86489]: INFO cinder.volume.drivers.remotefs [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] casted to osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73 Sep 28 21:56:46 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb 1073741824 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:46 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb 1073741824 Sep 28 21:56:46 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:47 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb 1073741824" returned: 0 in 0.417s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:47 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb Sep 28 21:56:47 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:47 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb" returned: 0 in 0.240s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'} {{(pid=86489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f12f02-2d0f-4ce6-8d05-a6fecb12235b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dcc3b88-f766-4a29-9cab-91114611a9eb', 'volume_size': 1}' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf997ad-24df-433a-a4a9-628f3e6cdf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 21:56:47 devstack cinder-volume[86489]: INFO cinder.volume.flows.manager.create_volume [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Volume volume-1dcc3b88-f766-4a29-9cab-91114611a9eb (1dcc3b88-f766-4a29-9cab-91114611a9eb): created successfully Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf997ad-24df-433a-a4a9-628f3e6cdf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86489) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Flow 'volume_create_manager' (e2103498-097f-490c-b940-00dd44831557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86489) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 21:56:47 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-3aaf10de-98fb-4c16-b6a1-305502bc5035 tempest-ProjectMemberTests-149632569 None] Created volume successfully. Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Creating offline snapshot 7f2ed34f-0f43-4e78-899e-c85e63de910d of volume 1dcc3b88-f766-4a29-9cab-91114611a9eb {{(pid=86489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a252315d-c82b-4015-967a-7902eef5785a]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:47 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:47 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb Sep 28 21:56:47 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:48 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb" returned: 0 in 0.363s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d 1G {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:48 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d 1G Sep 28 21:56:48 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:48 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d 1G" returned: 0 in 0.387s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dcc3b88-f766-4a29-9cab-91114611a9eb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:48 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dcc3b88-f766-4a29-9cab-91114611a9eb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d Sep 28 21:56:48 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:48 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dcc3b88-f766-4a29-9cab-91114611a9eb -F qcow2 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d" returned: 0 in 0.293s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:48 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d is being set with open permissions: ugo+rw Sep 28 21:56:48 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:48 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d Sep 28 21:56:48 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:49 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d" returned: 0 in 0.243s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:49 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.info Sep 28 21:56:49 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:49 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.info" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:49 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.remotefs [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.info is being set with open permissions: ugo+rw Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.info {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:49 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.info Sep 28 21:56:49 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:49 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.info" returned: 0 in 0.258s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:49 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-63f7d7ac-322f-4443-ade1-89769f54b1d8 tempest-ProjectMemberTests-149632569 None] Create snapshot completed successfully Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-7f2ed34f-0f43-4e78-899e-c85e63de910d-delete_snapshot" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-7f2ed34f-0f43-4e78-899e-c85e63de910d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-1dcc3b88-f766-4a29-9cab-91114611a9eb" by "delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-1dcc3b88-f766-4a29-9cab-91114611a9eb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-7f2ed34f-0f43-4e78-899e-c85e63de910d" by "_delete_snapshot" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-7f2ed34f-0f43-4e78-899e-c85e63de910d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:49 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Deleting offline snapshot 7f2ed34f-0f43-4e78-899e-c85e63de910d of volume 1dcc3b88-f766-4a29-9cab-91114611a9eb {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] snapshot_file for this snap is: volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d {{(pid=86489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2347ae1f-738b-42e1-ac28-3a9b0bca9d81]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:50 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d Sep 28 21:56:50 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:50 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d" returned: 0 in 0.347s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dcc3b88-f766-4a29-9cab-91114611a9eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21ce0b-099e-41bf-b9f8-46c065a97ecc]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:50 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb Sep 28 21:56:50 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:50 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb" returned: 0 in 0.361s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:50 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:50 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d Sep 28 21:56:50 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:51 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d" returned: 0 in 0.340s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:51 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d Sep 28 21:56:51 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:51 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:51 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb.7f2ed34f-0f43-4e78-899e-c85e63de910d" returned: 0 in 0.253s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-7f2ed34f-0f43-4e78-899e-c85e63de910d" released by "_delete_snapshot" :: held 1.394s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-1dcc3b88-f766-4a29-9cab-91114611a9eb" released by "delete_snapshot" :: held 1.416s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:51 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Created reservations ['d841b3dd-a539-419e-a8c9-1031bcf5efbd', '3ee4a3ba-dc40-468b-859c-e98f49698c35', '18ba2a39-d1bc-421a-90e8-82ed01687fd0', 'a229395b-af0c-4886-8fc1-8e1bcedcdc50'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:51 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Delete snapshot completed successfully. Sep 28 21:56:51 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-79748fea-5f43-4e24-b29e-7a9d7bdfd6e4 tempest-ProjectMemberTests-149632569 None] Lock "cinder-7f2ed34f-0f43-4e78-899e-c85e63de910d-delete_snapshot" released by "delete_snapshot" :: held 1.551s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-1dcc3b88-f766-4a29-9cab-91114611a9eb-delete_volume" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Lock "cinder-1dcc3b88-f766-4a29-9cab-91114611a9eb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Acquiring lock "cinder-quobyte-1dcc3b88-f766-4a29-9cab-91114611a9eb" by "delete_volume" {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-1dcc3b88-f766-4a29-9cab-91114611a9eb" acquired by "delete_volume" :: waited 0.015s {{(pid=86489) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e664a66-dba7-40bd-80a9-3799f684d70d]: (4, 'qcow2') {{(pid=88244) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:52 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb Sep 28 21:56:52 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:52 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb" returned: 0 in 0.359s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:52 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb Sep 28 21:56:52 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:52 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483/volume-1dcc3b88-f766-4a29-9cab-91114611a9eb" returned: 0 in 0.242s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Lock "cinder-quobyte-1dcc3b88-f766-4a29-9cab-91114611a9eb" released by "delete_volume" :: held 0.661s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG cinder.quota [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Created reservations ['e51b3d2b-36de-49ad-ba76-bc92aa9862a8', '18c30095-4317-4b2c-86ac-a9c2896e2827', 'dd48e152-1377-4ce9-92f5-cd867b548d27', '85f6d785-e23a-4620-b368-dcebe24d0c48'] {{(pid=86489) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:56:52 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:56:52 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:56:52 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:56:53 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 28 21:56:53 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.263s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:56:53 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:56:53 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Deleted volume successfully. Sep 28 21:56:53 devstack cinder-volume[86489]: DEBUG cinder.coordination [None req-076f5cf5-ea00-4c42-aa0f-92436036b17f tempest-ProjectMemberTests-149632569 None] Lock "cinder-1dcc3b88-f766-4a29-9cab-91114611a9eb-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86489) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 21:57:02 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=103,cinder:INSERT=37,cinder:UPDATE=116,cinder:DELETE=10 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:57:03 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=79,cinder:INSERT=30,cinder:UPDATE=120,cinder:DELETE=8 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fc4bafa7-95fc-41f8-b986-1d210f43ad73'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 21:57:07 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483 Sep 28 21:57:07 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 21:57:07 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9af54356097156fdc4b1539340506483" returned: 0 in 0.262s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG oslo_service.periodic_task [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] Running periodic task VolumeManager._thread_info {{(pid=86489) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread count: 29 {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 21:57:07 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-83d6cdde-7353-45f4-ab59-f4641ed2404d None None] thread info: [<_MainThread(MainThread, started 123249289990272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86489) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 21:57:21 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 21:57:21 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:UPDATE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}